-- Logs begin at Wed 2021-10-27 13:23:34 UTC, end at Wed 2021-10-27 14:24:23 UTC. -- Oct 27 13:59:39.156493 dv-cinder-815660-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 13:59:39.165238 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 13:59:39.167215 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 27 13:59:39 2021] *** Oct 27 13:59:39.167215 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 13:59:39.167215 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 13:59:39.167215 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: nodename: dv-cinder-815660-2-iscsi Oct 27 13:59:39.167215 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: machine: x86_64 Oct 27 13:59:39.167215 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: clock source: unix Oct 27 13:59:39.167215 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: pcre jit disabled Oct 27 13:59:39.167215 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: detected number of CPU cores: 4 Oct 27 13:59:39.167215 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: current working directory: / Oct 27 13:59:39.167215 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: detected binary path: /usr/bin/uwsgi-core Oct 27 13:59:39.167916 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: your processes number limit is 47680 Oct 27 13:59:39.167916 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: your memory page size is 4096 bytes Oct 27 13:59:39.167916 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: detected max file descriptor number: 2048 Oct 27 13:59:39.167916 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: lock engine: pthread robust mutexes Oct 27 13:59:39.167916 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: thunder lock: enabled Oct 27 13:59:39.167916 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 13:59:39.167916 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 27 13:59:39.211815 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: Python main interpreter initialized at 0x5606a50939c0 Oct 27 13:59:39.211815 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: python threads support enabled Oct 27 13:59:39.211815 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: your server socket listen backlog is limited to 100 connections Oct 27 13:59:39.211815 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: your mercy for graceful operations on workers is 90 seconds Oct 27 13:59:39.212187 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 13:59:39.212262 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: *** Operational MODE: preforking *** Oct 27 13:59:39.212493 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: *** uWSGI is running in multiple interpreter mode *** Oct 27 13:59:39.212493 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: spawned uWSGI master process (pid: 100962) Oct 27 13:59:39.212693 dv-cinder-815660-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 13:59:39.213523 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: spawned uWSGI worker 1 (pid: 100963, cores: 1) Oct 27 13:59:39.213632 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: spawned uWSGI worker 2 (pid: 100964, cores: 1) Oct 27 13:59:39.213786 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 13:59:40.882953 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:59:40.882953 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: from cryptography.utils import int_from_bytes Oct 27 13:59:40.883621 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:59:40.883621 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: from cryptography.utils import int_from_bytes Oct 27 13:59:40.884066 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:59:40.884066 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: from cryptography.utils import int_from_bytes Oct 27 13:59:40.884182 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:59:40.884182 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: from cryptography.utils import int_from_bytes Oct 27 13:59:43.528953 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 13:59:43.529624 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 13:59:43.529624 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 13:59:43.530003 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 13:59:43.530255 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 13:59:43.530646 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.530971 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.531366 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.531693 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.532022 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.532333 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.532659 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.532823 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 13:59:43.533184 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.533274 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 13:59:43.533361 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.533523 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 13:59:43.533616 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.533847 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.533932 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 13:59:43.534114 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 13:59:43.534199 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-2-iscsi {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.534486 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.534572 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.534796 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.534886 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.535108 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.535224 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.535448 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.535535 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.535752 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.535838 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.536058 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.536151 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.536373 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.536491 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.536683 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.536886 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.537003 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.537236 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.537361 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.537547 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.537683 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.537861 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-2-iscsi {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.537987 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.538175 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.538298 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.538477 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.538566 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.538779 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.538904 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.539090 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.539249 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.539412 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.539549 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.539729 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.539824 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.540109 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.540219 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.540449 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-2-iscsi {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.540548 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.540749 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.540881 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.541060 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.541153 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.541374 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.541459 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.541708 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.541798 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.542017 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.542119 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.542320 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.542418 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.542631 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.542718 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.542933 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.543036 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.543270 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.543923 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.544161 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.544319 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.544473 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.544800 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.544915 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-2-iscsi {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.545118 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.545244 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.545419 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.545506 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.545730 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.545821 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.546038 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.546185 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.546357 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.546491 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.546662 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.546797 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.546967 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.547109 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.547231 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.547451 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.547537 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.547755 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.547848 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.548074 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.548159 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.548386 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.548476 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.548697 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.548806 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.548952 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.549046 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.549273 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.549385 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.549574 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.549672 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.549877 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.549972 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.550185 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.550312 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.550473 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.550558 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.550775 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.550890 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.551014 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.551107 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.551340 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.551426 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.551653 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.551748 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.551964 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.552050 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.552278 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.552365 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.552524 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.552609 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.552767 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.552899 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.553077 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.553209 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.553388 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.553528 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.553690 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.553922 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.554033 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.554178 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.554334 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.554477 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.554615 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.554817 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.554963 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.555153 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.555245 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.555463 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.555549 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.555764 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.555850 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.556073 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.556159 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.556380 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.556465 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.556685 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.556771 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.556984 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.557077 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.557296 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.557392 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.557625 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.557709 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.557913 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.558010 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.558168 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.558253 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.558468 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.558560 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.558772 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.558873 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.559674 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.559824 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.559974 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.560365 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.560465 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.560592 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.560679 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.560914 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.561014 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.561199 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.561300 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.561505 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.561599 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.561811 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.561897 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.562116 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.562214 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.562419 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.562505 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.562694 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.562779 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.562991 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.563089 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.563323 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.563412 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.563627 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.563719 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.563926 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.564023 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.564229 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.564354 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.564531 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.564630 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.564825 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.564911 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.565126 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.565212 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.565429 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.565522 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.565730 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.565826 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.566030 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.566123 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.566331 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.566417 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.566627 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.566724 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.566927 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.567013 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.567250 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.567339 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.567553 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.567640 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.567858 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.567979 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.568164 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.568248 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.568462 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.568547 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.568762 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.568848 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.569061 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.569149 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.569361 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.569455 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.569665 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.569805 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.569962 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.570049 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.570262 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.570347 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.570565 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.570650 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.570860 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.570950 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.571178 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.571267 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.571485 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.571577 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.571783 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.571875 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.572081 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.572172 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.572388 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.572476 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.572682 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.572775 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.572983 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.573069 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.573291 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.573384 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.573592 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.573684 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.573889 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.573980 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.574188 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.574279 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.574485 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.574666 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.574931 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.575024 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.575270 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.575442 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.575608 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.575748 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.575941 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.576104 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.576262 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.576348 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.576576 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.576662 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.576892 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.576978 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.577219 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.577310 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.577518 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.577604 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.577817 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.577901 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.578130 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.578214 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:59:43.578451 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.578539 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.578770 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.578861 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.579098 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.579222 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.579440 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.579524 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.579757 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.579840 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.580079 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.580176 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.580389 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.580472 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.580697 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.580788 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.581006 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.581100 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.581326 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.581428 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.581633 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.581718 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.581941 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.582033 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.582250 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.582337 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.582562 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.582647 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.582875 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.582969 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.583224 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.583315 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.583537 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.583622 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.583848 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.583947 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.584159 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.584243 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.584465 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.584592 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.584776 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.584870 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.585098 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.585183 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.585411 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.585504 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.585719 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.585804 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.586052 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.586145 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.586375 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.586460 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.586681 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.586767 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.586988 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.587073 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.587321 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.587419 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.587637 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.587723 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.587942 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.588026 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.588250 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.588343 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.588558 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.588648 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.588871 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.588961 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.589179 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.589324 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.589487 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.589573 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.589797 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.589880 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.590108 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.590205 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.590479 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.590735 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.590836 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.591100 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.591341 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.591439 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.591522 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.591738 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.591826 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.592050 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.592144 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.592358 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.592455 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.592673 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.592757 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.592977 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.593070 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.593284 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.593369 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.593604 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.593688 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.593902 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.593999 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.594208 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.594294 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.594564 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.594699 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.594815 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.594910 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.595150 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.595240 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.595454 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.595540 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.595755 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.595849 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.596072 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.596166 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.596378 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.596464 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.596680 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.596767 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.596997 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.597090 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.597297 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.597383 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.597595 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.597683 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.597906 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.597991 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.598212 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.598350 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.598518 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.598611 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.598822 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.598907 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.599182 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.599286 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.599466 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.599552 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.599770 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.599855 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.600075 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.600206 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.600381 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.600468 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.600685 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.600774 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.601005 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.601102 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.601315 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.601406 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.601623 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.601708 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.601921 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.602015 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.602224 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.602310 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.602523 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.602611 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.602824 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.602917 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.603124 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.603232 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.603450 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.603535 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.603747 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.603834 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.604047 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.604154 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.604345 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.604476 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.604643 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.604823 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.604941 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.605100 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.605261 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.605412 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.605563 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.605724 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.606399 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.606701 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.606859 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.607091 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.607390 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.607489 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.607737 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.607825 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.608042 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.608136 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.608367 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.608451 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.608682 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.608769 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.609002 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.609094 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.609306 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.609391 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.609618 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.609703 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.609930 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.610026 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.610252 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.610351 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.610539 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.610633 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.610846 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.610942 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.611170 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.611270 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.611488 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.611573 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.611797 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.611891 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.612109 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.612193 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.612412 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.612537 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.612722 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.612822 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.613029 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.613155 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.613343 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.613441 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.613638 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.613740 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.613949 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.614045 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.614271 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.614364 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.614582 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.614678 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.614891 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.614985 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.615230 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.615339 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.615545 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.615888 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.616106 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.616202 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.616411 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.616531 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.616717 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.616811 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.617023 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.617117 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.617327 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.617429 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.617639 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.617732 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.617943 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.618044 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.618254 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.618355 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.618556 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.618659 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.618860 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.618954 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.619186 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.619333 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.619507 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.619620 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.619951 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.620537 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.621155 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.621675 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.621873 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.622120 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.622295 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.622529 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.622697 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.622860 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.623201 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.623487 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.623578 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.623821 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.623925 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.624131 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.624218 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.624439 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.624529 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.624751 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.624853 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.625489 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.625617 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.625724 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.625828 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.625947 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.626053 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.626157 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.626270 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.626383 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.626488 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.626608 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.626721 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.626826 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.626993 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.627114 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.627340 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.627467 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.627654 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.627774 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.630101 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.630240 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.630317 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.630412 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.630499 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.630568 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.630634 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.630698 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.630841 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.630931 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631000 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631064 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631064 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631211 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631294 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631362 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631427 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631491 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631554 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631624 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631699 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631765 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631844 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.631930 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.632015 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.632105 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.632192 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.632283 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.632363 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.632446 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.632525 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.632610 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.632836 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.632939 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.633105 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.633199 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.633409 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.633518 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.633725 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.633811 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.634037 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.634124 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.634342 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.634436 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.634649 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.634744 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.634957 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.635043 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.635287 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.635391 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.635600 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.635877 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.635964 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.636208 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.636304 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.636516 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.636602 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.636822 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.636908 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.637636 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.637747 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.637964 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.638095 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.638296 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.638630 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.638717 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.638955 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.639230 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.639365 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.639562 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.639682 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.639878 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.640015 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.640186 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.640305 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.640500 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.640616 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.640808 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.640930 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.641115 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.641231 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.641421 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.641547 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.641737 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.641855 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.642039 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.642154 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.642342 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.642456 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.642642 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.642758 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.643577 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.643709 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.643837 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.643947 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.644058 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.644165 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.644264 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.644359 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.644466 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.644563 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.644666 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.644773 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.644881 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.644986 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.645090 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.645187 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.645491 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.645625 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.645725 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.645831 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.645937 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.646033 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.646259 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.646397 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.646531 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.646652 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.646864 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.647010 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.647168 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.647321 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.647453 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.647576 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.647734 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.647868 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.648037 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.648786 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.648916 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.649038 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.649161 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.649284 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.649431 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.649547 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.649623 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.649746 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.649877 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.650007 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.650158 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.650290 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.650402 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.650475 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.650542 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.650631 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.650772 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.650898 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.651074 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.651278 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.651399 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.651500 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.651776 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.651878 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.652000 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.652088 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.652304 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.652404 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.652603 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.652690 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.653557 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.653674 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.653869 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.654108 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.654285 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.654484 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.654581 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.654788 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.654887 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.655093 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.655208 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.655421 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.655508 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.655723 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.655823 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.656030 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.656124 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.656335 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.656422 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.656635 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.656730 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.656935 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.657024 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.657243 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.657329 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.657546 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.657646 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.657842 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.657929 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.658147 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.658234 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.658449 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.658541 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.658754 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.658849 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.659052 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.659163 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.659382 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.659471 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.659680 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.659766 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.659986 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.660074 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.660291 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.660380 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.660587 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.660676 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.660899 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.660986 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.661203 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.661291 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.661503 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.661591 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.661803 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.661899 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.662106 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.662194 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.662403 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.662490 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.662704 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.662798 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.663011 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.663121 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.663338 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.663435 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.663934 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.664194 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.664194 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.664416 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.664514 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.664596 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.664677 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.664768 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.664850 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.664930 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.665090 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.665191 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.665395 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.665484 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.665695 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.665789 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.665993 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.666080 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.666289 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.666377 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.666587 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.666674 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.666883 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.666977 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.667234 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.667329 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.667543 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.667631 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.667845 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.667933 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.668146 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.668236 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.668518 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.668622 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.668819 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.669105 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.669333 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.669667 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.669782 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.669878 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.669968 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.670063 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.670146 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.670355 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.670459 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.670677 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.670764 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.670986 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.671076 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.671320 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.671410 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.671635 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.671725 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.671934 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.672023 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.672246 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.672334 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.672554 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.672643 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.672861 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.672956 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.673156 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.673250 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.673456 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.673553 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.673766 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.673866 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.674072 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.674166 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.674378 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.674475 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.674687 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.674773 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.674997 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.675085 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.675333 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.675437 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.675631 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.675718 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.675938 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.676086 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.676245 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.676342 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.676546 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.676632 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.676847 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.676933 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.677152 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.677247 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.677452 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.677545 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.677759 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.677852 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.678060 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.678147 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.678365 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.678458 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.678665 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.678754 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.678965 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.679098 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.679295 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.679432 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.679599 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.679745 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.679900 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.680051 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.680217 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.680362 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.680521 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.680674 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.680821 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.680990 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.681123 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.681308 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.681423 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.681613 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.681728 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.682025 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.682118 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.682336 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.682453 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.682648 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.682766 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.682960 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.683080 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.683287 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.683457 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.683597 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.684026 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.684137 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.684230 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.684319 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.684573 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.684688 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.684880 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.685049 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.685183 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.685357 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.685505 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.685775 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.685916 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.686087 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.686226 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.686396 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.686542 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.686705 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.686856 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.686992 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.687083 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.687328 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.687581 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.687680 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.687934 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.688033 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.688215 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.688321 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.688532 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.688811 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.689080 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.689169 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.689258 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.689349 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.689435 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.689513 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.689714 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.689808 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.690034 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.690130 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.690356 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.690450 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.690677 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.690763 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.690987 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.691082 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.691326 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.691416 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.691630 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.691716 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.691958 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.692047 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.692277 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.692363 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.692590 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.692676 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.692909 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.692997 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.693217 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.693302 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.693523 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.693609 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.693842 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.694071 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.694171 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.694252 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.694454 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.694548 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.694762 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.694856 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.695058 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.695164 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.695399 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.695498 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.695722 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.695815 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.696029 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.696118 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.696341 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.696427 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.696640 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.696735 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.696951 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.697039 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.697262 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.697349 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.697569 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.697672 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.697872 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.697967 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.698174 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.698268 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.698494 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.698594 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.698794 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.698887 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.699103 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.699208 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.699436 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.699535 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.700273 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.700370 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.700595 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.700882 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.701085 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.701206 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.701410 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.701518 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.701720 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.701828 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.702035 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.702122 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.702341 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.702436 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.702647 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.702733 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.702990 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.703079 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.703320 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.703409 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.703643 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.703740 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.703960 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.704222 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.704310 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.704390 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.704565 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.704662 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.704883 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.704971 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.705189 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.705277 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.705489 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.705584 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.705795 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.705890 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.706097 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.706191 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.706417 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.706512 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.706719 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.706806 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.707029 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.707124 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.707363 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.707461 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.707668 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.707754 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.707970 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.708059 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.708278 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.708366 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.708579 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.708667 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.708883 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.708969 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.709186 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.709274 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.709503 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.709588 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.709803 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.709896 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.710100 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.710187 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.710406 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.710493 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.710706 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.710792 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.711005 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.711094 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.711330 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.711426 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.711633 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.711728 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.711932 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.712020 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.712230 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.712317 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.712526 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.712628 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.712843 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.712931 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.713142 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.713231 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.713459 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.713559 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.713765 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.713864 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.714064 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.714336 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.714426 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.714514 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.714650 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.714737 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.714987 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.715074 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.715975 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.716083 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.716520 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.716607 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.716840 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.716928 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.717153 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.717241 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.717471 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.717558 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.717789 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.717875 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.718104 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.718199 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.718475 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.718664 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.718789 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.718991 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.719090 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.719328 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.719424 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.719641 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.719728 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.719952 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.720041 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.720266 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.720353 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.720578 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.720664 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.720889 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.721017 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.721200 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.721287 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.721509 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.721594 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.721816 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.722053 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.722139 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.722377 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.722463 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.722688 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.722776 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.722996 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.723089 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.723345 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.723436 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.723657 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.723746 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.723966 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.724052 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.724338 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.724470 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.724573 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.724660 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.724879 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.724984 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.725185 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.725295 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.725501 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.725625 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.725820 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.725919 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.726138 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.726242 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.726448 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.726536 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.726759 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.726847 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.727070 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.727193 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.727408 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.727496 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.727717 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.727806 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.728026 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.728116 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.728338 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.728427 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.728649 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.728739 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.728961 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.729085 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.729275 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.729377 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.729586 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.729685 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.729899 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.730025 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.730199 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.730300 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.730499 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.730666 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.730807 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.731050 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.731354 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.731457 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.731711 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.731823 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.732039 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.732145 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.732368 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.732457 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.732685 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.732782 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.733003 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.733098 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.733323 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.733411 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.733626 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.733721 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.733932 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.734026 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.734244 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.734346 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.734584 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.734750 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.734848 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.735058 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.735168 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.735413 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.735516 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.735735 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.735831 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.736060 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.736148 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.736368 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.736457 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.736677 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.736897 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.736985 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.737244 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.737341 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.737561 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.737651 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.737865 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.737953 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.738169 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.738334 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.738468 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.738556 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.738782 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.738870 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.739087 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.739208 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.739421 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.739520 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.739725 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.739813 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.740027 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.740115 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.740332 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.740548 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.740886 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.741139 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.741245 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.741450 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.741538 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.741760 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.741846 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.742062 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.742158 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.742374 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.742460 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.742674 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.742760 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.742989 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.743083 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.743313 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.743401 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.743610 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.743697 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.743909 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.743997 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.744247 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.744355 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.744508 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.744726 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.744833 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.744917 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.745089 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.745176 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.745388 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.745475 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.745702 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.745849 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.745982 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.746069 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.746282 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.746378 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.746716 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.746812 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.746919 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.747250 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.747354 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.747560 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.747650 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.747861 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.747945 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.748181 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.748269 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.748482 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.748570 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.748782 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.748868 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.749081 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.749168 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.749382 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.749531 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.749689 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.749778 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.749989 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.750078 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.750293 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.750389 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.750590 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.750687 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.750896 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.750992 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.751219 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.751491 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.751580 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.751812 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.751898 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.752128 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.752219 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.752426 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.752514 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.752723 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.752833 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.753031 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.753142 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.753337 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.753434 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.753651 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.753739 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.753958 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.754047 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.754278 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.754374 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.754605 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.754757 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.754920 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.755040 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.755268 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.755471 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.755571 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.755856 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.755954 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.756172 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.756268 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.756484 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.756589 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.756793 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.756891 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.757123 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.757219 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.757429 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.757534 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.757733 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.757837 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.758050 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.758148 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.758361 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.758467 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.758670 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.758767 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.758974 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.759069 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.759305 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.759414 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.759612 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.759765 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.759907 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.760046 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.760211 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.760360 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.760520 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.760667 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.760828 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.760972 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.761161 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.761306 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.761476 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.761616 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.761789 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.761928 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.762637 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.762778 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.763095 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.763233 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.763545 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.763635 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.763878 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.763975 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.764195 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.764284 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.764501 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.764597 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.764818 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.764917 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.765143 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.765242 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.765451 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.765549 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.765755 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.765844 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.766097 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.766186 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.766404 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.766501 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.766709 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.766805 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.767013 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.767102 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.767348 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.767440 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.767687 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.767775 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.768001 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.768097 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.768314 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.768404 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.768626 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.768713 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.768935 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.769022 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.769242 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.769330 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.769563 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.769651 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.769883 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.769985 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.770199 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.770288 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.770498 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.770591 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.770798 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.770899 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.771100 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.771208 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.771440 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.771528 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.771748 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.771851 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.772057 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.772146 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.772364 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.772461 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.772670 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.772765 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.772988 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.773076 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.773294 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.773381 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.773600 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.773688 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.773913 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.774001 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.774225 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.774313 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.774530 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.774629 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.774914 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.775014 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.775169 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.775275 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.775477 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.775576 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.775784 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.775874 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.776089 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.776202 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.776395 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.776483 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.776696 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.776781 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.777008 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.777102 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.777323 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.777417 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.777621 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.777742 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.778057 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.778187 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.778385 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.778632 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.778719 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.779004 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.779099 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.779364 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.779454 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.779673 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.779784 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.780001 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.780105 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.780265 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 13:59:43.780357 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.780608 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.780916 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.781225 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.781538 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.781850 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.782172 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.782492 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.782811 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.783153 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.783492 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.783802 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.784142 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.784467 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:59:43.784706 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100964) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 13:59:43.803255 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_db.sqlalchemy.engines [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 13:59:43.807754 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG oslo_db.sqlalchemy.engines [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 13:59:43.977533 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.context [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c89c5998-b04c-4a8a-a40e-c04db17dd463(cell1) {{(pid=100963) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 13:59:43.982656 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 13:59:43.984265 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 13:59:43.984666 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.context [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c89c5998-b04c-4a8a-a40e-c04db17dd463(cell1) {{(pid=100964) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 13:59:43.985071 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 13:59:43.986963 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 13:59:43.988997 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG oslo_concurrency.lockutils [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 13:59:43.990558 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG oslo_concurrency.lockutils [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 13:59:43.991621 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG oslo_concurrency.lockutils [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 13:59:43.993516 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG oslo_concurrency.lockutils [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100964) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 13:59:43.997337 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_db.sqlalchemy.engines [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 13:59:44.000246 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_db.sqlalchemy.engines [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 13:59:44.005816 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG oslo_db.sqlalchemy.engines [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 13:59:44.010189 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG oslo_db.sqlalchemy.engines [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 13:59:44.264585 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_db.sqlalchemy.engines [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 13:59:44.270588 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG oslo_db.sqlalchemy.engines [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100964) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 13:59:44.613257 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: WARNING keystonemiddleware.auth_token [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:59:44.617732 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: WARNING keystonemiddleware.auth_token [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:59:44.620004 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: WARNING keystonemiddleware.auth_token [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:59:44.624381 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: WARNING keystonemiddleware.auth_token [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:59:44.970708 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: WARNING keystonemiddleware.auth_token [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:59:44.972694 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: WARNING keystonemiddleware.auth_token [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:59:44.976207 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: WARNING keystonemiddleware.auth_token [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:59:44.977833 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: WARNING keystonemiddleware.auth_token [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:59:44.982354 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5606a50939c0 pid: 100963 (default app) Oct 27 13:59:44.984180 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5606a50939c0 pid: 100964 (default app) Oct 27 13:59:44.984430 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:59:44.985610 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-367149d1-14c3-4a96-8aaf-6820d5a7380c None None] 10.222.0.85 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001718 Oct 27 13:59:44.986025 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 788 bytes} [Wed Oct 27 13:59:44 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:08.479715 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:08.481005 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Oct 27 14:01:08.481457 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 1/2] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:08 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:08.932706 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-a8ad3ed9-afe1-4c17-b8b2-2254fbda95c6 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:08.963034 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-a8ad3ed9-afe1-4c17-b8b2-2254fbda95c6 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.473716 Oct 27 14:01:08.963819 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 2/3] 10.222.0.85 () {60 vars in 1291 bytes} [Wed Oct 27 14:01:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:01:11.480194 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:11.481720 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-e9eb1c84-7ec7-4fd5-98d0-fa76cce8c729 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002067 Oct 27 14:01:11.482260 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 2/4] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:11.545060 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-eec86ded-78c7-45b1-96c8-7ed7a8130902 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "ram": 256, "rxtx_factor": 1.0}} {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:11.566140 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:01:11.566140 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: warnings.warn(msg) Oct 27 14:01:11.597211 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-eec86ded-78c7-45b1-96c8-7ed7a8130902 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107303 Oct 27 14:01:11.598167 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 3/5] 10.222.0.85 () {64 vars in 1282 bytes} [Wed Oct 27 14:01:11 2021] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:01:11.826072 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-bdd26c18-40da-46b9-b97b-13488d8225d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:11.828368 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:01:11.828368 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: warnings.warn(msg) Oct 27 14:01:11.885517 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-bdd26c18-40da-46b9-b97b-13488d8225d5 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278818 Oct 27 14:01:11.886179 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 3/6] 10.222.0.85 () {64 vars in 1335 bytes} [Wed Oct 27 14:01:11 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:01:14.306683 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-eec86ded-78c7-45b1-96c8-7ed7a8130902 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:14.307766 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-eec86ded-78c7-45b1-96c8-7ed7a8130902 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Oct 27 14:01:14.308450 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 4/7] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:14.431455 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-1fd57e7a-2579-482f-b5d8-de6c72ba9ef4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "ram": 512, "rxtx_factor": 1.0, "disk": 5}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:14.450518 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:01:14.450518 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: warnings.warn(msg) Oct 27 14:01:14.471897 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-1fd57e7a-2579-482f-b5d8-de6c72ba9ef4 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156624 Oct 27 14:01:14.472841 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 4/8] 10.222.0.85 () {64 vars in 1282 bytes} [Wed Oct 27 14:01:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:01:14.485473 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-487f7cad-c3f3-45f4-9ecc-70673511d42b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:14.486994 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:01:14.486994 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: warnings.warn(msg) Oct 27 14:01:14.525686 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-487f7cad-c3f3-45f4-9ecc-70673511d42b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044401 Oct 27 14:01:14.526309 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 5/9] 10.222.0.85 () {64 vars in 1335 bytes} [Wed Oct 27 14:01:14 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:01:17.022037 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-1fd57e7a-2579-482f-b5d8-de6c72ba9ef4 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:17.025164 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-1fd57e7a-2579-482f-b5d8-de6c72ba9ef4 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003720 Oct 27 14:01:17.027438 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 5/10] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:17 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:17.116505 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-2c51cda0-a4e2-417f-b5bb-c7e0a94ab222 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2"}} {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:17.153010 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-2c51cda0-a4e2-417f-b5bb-c7e0a94ab222 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.111900 Oct 27 14:01:17.153010 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 6/11] 10.222.0.85 () {64 vars in 1282 bytes} [Wed Oct 27 14:01:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:01:17.177540 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-0d0a3b4b-c990-40f7-99e4-daed32280cb5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:17.209155 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-0d0a3b4b-c990-40f7-99e4-daed32280cb5 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041512 Oct 27 14:01:17.211846 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 6/12] 10.222.0.85 () {64 vars in 1335 bytes} [Wed Oct 27 14:01:17 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:01:19.887864 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-2c51cda0-a4e2-417f-b5bb-c7e0a94ab222 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:19.888964 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-2c51cda0-a4e2-417f-b5bb-c7e0a94ab222 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Oct 27 14:01:19.889442 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 7/13] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:19.977485 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-175d940b-b237-4679-9d75-221f3147d4b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d3"}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:19.999081 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-175d940b-b237-4679-9d75-221f3147d4b5 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.100758 Oct 27 14:01:19.999675 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 7/14] 10.222.0.85 () {64 vars in 1282 bytes} [Wed Oct 27 14:01:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:01:20.013869 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-361be79f-282c-414f-a26f-d3d467f9b5ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:20.052982 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-361be79f-282c-414f-a26f-d3d467f9b5ab admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042779 Oct 27 14:01:20.054214 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 8/15] 10.222.0.85 () {64 vars in 1335 bytes} [Wed Oct 27 14:01:20 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:01:22.484009 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-175d940b-b237-4679-9d75-221f3147d4b5 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:22.486238 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-175d940b-b237-4679-9d75-221f3147d4b5 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Oct 27 14:01:22.486648 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 8/16] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:22 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:22.554923 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-63de2e9a-8e36-4197-a82c-0952c4aca50c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4"}} {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:22.578256 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-63de2e9a-8e36-4197-a82c-0952c4aca50c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084044 Oct 27 14:01:22.583242 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 9/17] 10.222.0.85 () {64 vars in 1282 bytes} [Wed Oct 27 14:01:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:01:22.592618 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-13f117ab-5253-4a78-8a3c-254ed982ec3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:22.619591 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-13f117ab-5253-4a78-8a3c-254ed982ec3c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030546 Oct 27 14:01:22.632100 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 9/18] 10.222.0.85 () {64 vars in 1335 bytes} [Wed Oct 27 14:01:22 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:01:25.010760 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-63de2e9a-8e36-4197-a82c-0952c4aca50c admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:25.011871 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-63de2e9a-8e36-4197-a82c-0952c4aca50c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Oct 27 14:01:25.012268 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 10/19] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:25.085993 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-1d35a8d5-a2de-4515-be1a-f826c3205c3b admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:25.108597 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-1d35a8d5-a2de-4515-be1a-f826c3205c3b admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089486 Oct 27 14:01:25.109147 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 10/20] 10.222.0.85 () {60 vars in 1291 bytes} [Wed Oct 27 14:01:25 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:01:27.848840 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-63de2e9a-8e36-4197-a82c-0952c4aca50c admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:27.849899 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-63de2e9a-8e36-4197-a82c-0952c4aca50c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 27 14:01:27.850355 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 11/21] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:27.910672 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-5c1a6815-ab9a-4fd5-ad99-3bf93568c8f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:27.932470 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-5c1a6815-ab9a-4fd5-ad99-3bf93568c8f0 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075140 Oct 27 14:01:27.933406 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 11/22] 10.222.0.85 () {64 vars in 1282 bytes} [Wed Oct 27 14:01:27 2021] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:01:27.946338 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-c31077a3-f657-42e1-885f-cf2534af52a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:27.969592 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-c31077a3-f657-42e1-885f-cf2534af52a8 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026866 Oct 27 14:01:27.970220 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 12/23] 10.222.0.85 () {64 vars in 1332 bytes} [Wed Oct 27 14:01:27 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:01:30.965947 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-5c1a6815-ab9a-4fd5-ad99-3bf93568c8f0 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:30.966946 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-5c1a6815-ab9a-4fd5-ad99-3bf93568c8f0 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 27 14:01:30.967381 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 12/24] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:31.027210 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-b4aaa62d-3816-4418-b7ca-01208ae474de admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "name": "m1.small"}} {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:31.045016 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-b4aaa62d-3816-4418-b7ca-01208ae474de admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070693 Oct 27 14:01:31.045571 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 13/25] 10.222.0.85 () {64 vars in 1282 bytes} [Wed Oct 27 14:01:30 2021] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:01:31.058226 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-a915fb20-57b4-4d1c-9ac6-c023644fae2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:31.081252 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-a915fb20-57b4-4d1c-9ac6-c023644fae2d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026537 Oct 27 14:01:31.082004 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 13/26] 10.222.0.85 () {64 vars in 1332 bytes} [Wed Oct 27 14:01:31 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:01:33.432036 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-b4aaa62d-3816-4418-b7ca-01208ae474de admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:33.433543 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-b4aaa62d-3816-4418-b7ca-01208ae474de admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001963 Oct 27 14:01:33.434041 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 14/27] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:33.498651 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-5ae11d5f-5f3a-45d3-89a3-dbe1d595cdf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:33.521046 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-5ae11d5f-5f3a-45d3-89a3-dbe1d595cdf4 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077970 Oct 27 14:01:33.521655 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 14/28] 10.222.0.85 () {64 vars in 1282 bytes} [Wed Oct 27 14:01:33 2021] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:01:33.534544 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-6d60d420-e6eb-4ba3-8065-2e53e4532255 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:33.558407 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-6d60d420-e6eb-4ba3-8065-2e53e4532255 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028006 Oct 27 14:01:33.559909 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 15/29] 10.222.0.85 () {64 vars in 1332 bytes} [Wed Oct 27 14:01:33 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:01:36.032852 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-5ae11d5f-5f3a-45d3-89a3-dbe1d595cdf4 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:36.034289 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-5ae11d5f-5f3a-45d3-89a3-dbe1d595cdf4 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 Oct 27 14:01:36.034959 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 15/30] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:36.118385 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-d952702f-067c-4831-adb7-63e2eb42b841 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "vcpus": 4, "disk": 80, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:36.139428 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-d952702f-067c-4831-adb7-63e2eb42b841 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.094616 Oct 27 14:01:36.140126 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 16/31] 10.222.0.85 () {64 vars in 1282 bytes} [Wed Oct 27 14:01:36 2021] POST /compute/v2.1/flavors => generated 405 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:01:36.156655 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-f398e828-8156-492c-99a5-cd96ee923c56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:36.198368 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-f398e828-8156-492c-99a5-cd96ee923c56 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048122 Oct 27 14:01:36.199777 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 16/32] 10.222.0.85 () {64 vars in 1332 bytes} [Wed Oct 27 14:01:36 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:01:38.585406 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-d952702f-067c-4831-adb7-63e2eb42b841 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:01:38.586520 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-d952702f-067c-4831-adb7-63e2eb42b841 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 27 14:01:38.586994 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 17/33] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:01:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:01:38.654121 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-8af32587-7ac1-4697-90ca-af0bf06b35d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:38.672749 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-8af32587-7ac1-4697-90ca-af0bf06b35d2 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079364 Oct 27 14:01:38.674372 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 17/34] 10.222.0.85 () {64 vars in 1282 bytes} [Wed Oct 27 14:01:38 2021] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:01:38.686152 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-02b6b2d3-3d88-42e6-b69c-403f8ee9b32c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:01:38.712906 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-02b6b2d3-3d88-42e6-b69c-403f8ee9b32c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030257 Oct 27 14:01:38.713813 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 18/35] 10.222.0.85 () {64 vars in 1332 bytes} [Wed Oct 27 14:01:38 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:02:17.732642 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-8af32587-7ac1-4697-90ca-af0bf06b35d2 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:17.733650 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-8af32587-7ac1-4697-90ca-af0bf06b35d2 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 27 14:02:17.734118 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 18/36] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:02:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:02:17.793464 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-acd906aa-308f-4c59-81b4-700e0e72c7ee admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:17.817954 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-acd906aa-308f-4c59-81b4-700e0e72c7ee admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.077123 Oct 27 14:02:17.818503 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 19/37] 10.222.0.85 () {60 vars in 1291 bytes} [Wed Oct 27 14:02:17 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:02:19.379852 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-8af32587-7ac1-4697-90ca-af0bf06b35d2 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:19.381081 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-8af32587-7ac1-4697-90ca-af0bf06b35d2 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001736 Oct 27 14:02:19.381518 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 19/38] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:02:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:02:19.572483 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-cf9d4ad4-3728-4781-ba6e-8b9bdb8d8260 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:19.577876 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.wsgi [None req-cf9d4ad4-3728-4781-ba6e-8b9bdb8d8260 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 14:02:19.578517 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-cf9d4ad4-3728-4781-ba6e-8b9bdb8d8260 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:02:19.579328 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-cf9d4ad4-3728-4781-ba6e-8b9bdb8d8260 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058679 Oct 27 14:02:19.579832 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 20/39] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Oct 27 14:02:19 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 14:02:19.589529 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-03398c5c-8e2c-4df9-91c1-b4df3eead9fc admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:19.610175 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-03398c5c-8e2c-4df9-91c1-b4df3eead9fc admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024146 Oct 27 14:02:19.610705 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 20/40] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Oct 27 14:02:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:02:19.620921 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-0b96ec71-b0a9-4bf9-b556-ab7f128ce0fb admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:19.642765 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-0b96ec71-b0a9-4bf9-b556-ab7f128ce0fb admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025241 Oct 27 14:02:19.643357 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 21/41] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Oct 27 14:02:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:02:19.653411 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-9def7192-d4b5-4825-b46e-c5c08a130a2d admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:19.659010 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.wsgi [None req-9def7192-d4b5-4825-b46e-c5c08a130a2d admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 14:02:19.659611 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-9def7192-d4b5-4825-b46e-c5c08a130a2d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:02:19.660400 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-9def7192-d4b5-4825-b46e-c5c08a130a2d admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010617 Oct 27 14:02:19.660898 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 21/42] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Oct 27 14:02:19 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 14:02:21.095251 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-0b96ec71-b0a9-4bf9-b556-ab7f128ce0fb admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:21.096241 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-0b96ec71-b0a9-4bf9-b556-ab7f128ce0fb admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 27 14:02:21.096632 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 22/43] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:02:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:02:21.288812 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-5431e6ed-f413-4aed-973f-952983151ee3 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:21.294458 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.wsgi [None req-5431e6ed-f413-4aed-973f-952983151ee3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 14:02:21.295021 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-5431e6ed-f413-4aed-973f-952983151ee3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:02:21.295843 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-5431e6ed-f413-4aed-973f-952983151ee3 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059421 Oct 27 14:02:21.296923 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 22/44] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Oct 27 14:02:21 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 27 14:02:21.306947 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-4e46573a-d225-4ff3-b638-b2620bcfafe8 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:21.320891 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-4e46573a-d225-4ff3-b638-b2620bcfafe8 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017589 Oct 27 14:02:21.321419 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 23/45] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Oct 27 14:02:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:02:21.331551 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-5497b9c9-c1e0-45a6-a419-c5267f00c2b1 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:21.345591 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-5497b9c9-c1e0-45a6-a419-c5267f00c2b1 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017494 Oct 27 14:02:21.346129 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 23/46] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Oct 27 14:02:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:02:21.356029 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-f31d5bdd-87cd-4854-8c50-48cf84f23cc1 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:21.361763 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.wsgi [None req-f31d5bdd-87cd-4854-8c50-48cf84f23cc1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 14:02:21.362322 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-f31d5bdd-87cd-4854-8c50-48cf84f23cc1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:02:21.363102 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-f31d5bdd-87cd-4854-8c50-48cf84f23cc1 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010599 Oct 27 14:02:21.363622 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 24/47] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Oct 27 14:02:21 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 14:02:22.782733 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-5497b9c9-c1e0-45a6-a419-c5267f00c2b1 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:22.783768 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-5497b9c9-c1e0-45a6-a419-c5267f00c2b1 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 27 14:02:22.784173 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 24/48] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:02:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:02:22.977267 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-5280ecd9-55ad-43b6-b304-6e5e3dfa7e34 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:22.982918 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.wsgi [None req-5280ecd9-55ad-43b6-b304-6e5e3dfa7e34 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 14:02:22.983534 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-5280ecd9-55ad-43b6-b304-6e5e3dfa7e34 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:02:22.984312 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-5280ecd9-55ad-43b6-b304-6e5e3dfa7e34 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059134 Oct 27 14:02:22.984802 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 25/49] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Oct 27 14:02:22 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 14:02:22.994457 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-3583caec-6325-4fbe-838c-a418734eb408 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:23.009004 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-3583caec-6325-4fbe-838c-a418734eb408 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017978 Oct 27 14:02:23.009536 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 25/50] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Oct 27 14:02:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:02:23.020418 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:23.033794 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016870 Oct 27 14:02:23.034324 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 26/51] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Oct 27 14:02:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:02:23.044052 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-a141493f-6617-4c9a-af07-2a978ea9bed9 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:23.049466 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.wsgi [None req-a141493f-6617-4c9a-af07-2a978ea9bed9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 14:02:23.050025 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-a141493f-6617-4c9a-af07-2a978ea9bed9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100964) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:02:23.050797 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-a141493f-6617-4c9a-af07-2a978ea9bed9 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010309 Oct 27 14:02:23.051322 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 26/52] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Oct 27 14:02:23 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 14:02:24.475121 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:24.476139 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 27 14:02:24.476538 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 27/53] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:02:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:02:24.669413 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-625a7425-9756-4d9e-b5a5-60d533716388 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:02:24.688872 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-625a7425-9756-4d9e-b5a5-60d533716388 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071868 Oct 27 14:02:24.689347 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 27/54] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Oct 27 14:02:24 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:02:26.129269 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:26.130302 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 27 14:02:26.130694 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 28/55] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:02:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:02:26.327785 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-645f0b28-41d6-45ae-a8b6-e3d2f90917b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:02:26.346779 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-645f0b28-41d6-45ae-a8b6-e3d2f90917b4 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073030 Oct 27 14:02:26.347374 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 28/56] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Oct 27 14:02:26 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:02:27.780348 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:27.781411 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Oct 27 14:02:27.781811 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 29/57] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:02:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:02:27.971848 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-931efde8-d7e6-430a-8ea0-14d9aeec1ffc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:02:27.991990 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-931efde8-d7e6-430a-8ea0-14d9aeec1ffc admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071459 Oct 27 14:02:27.992537 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 29/58] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Oct 27 14:02:27 2021] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:02:29.429608 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:29.430604 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Oct 27 14:02:29.430994 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 30/59] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:02:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:02:29.622953 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-b33fb546-087b-4a07-b86c-0de0a591fbab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:02:29.642254 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-b33fb546-087b-4a07-b86c-0de0a591fbab admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071946 Oct 27 14:02:29.642743 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 30/60] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Oct 27 14:02:29 2021] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:02:31.074361 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:31.075429 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 27 14:02:31.075824 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 31/61] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:02:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:02:31.267033 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-c1d9d578-2284-4beb-8a9f-e85b15834641 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:02:31.286521 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-c1d9d578-2284-4beb-8a9f-e85b15834641 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071821 Oct 27 14:02:31.286989 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 31/62] 10.222.0.85 () {60 vars in 1202 bytes} [Wed Oct 27 14:02:31 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:03:18.123779 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:03:18.124819 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-9caf4323-a8e0-4d3a-baf3-888e13278dd9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 27 14:03:18.125227 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 32/63] 10.222.0.85 () {54 vars in 930 bytes} [Wed Oct 27 14:03:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:03:18.183892 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-6431ab46-8581-4895-a077-b1e922ceadfd admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:03:18.203837 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-6431ab46-8581-4895-a077-b1e922ceadfd admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071848 Oct 27 14:03:18.204386 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 32/64] 10.222.0.85 () {60 vars in 1291 bytes} [Wed Oct 27 14:03:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:03:18.227069 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-626b186d-c4a5-4a6e-8b47-e1c958775edb admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:03:18.234797 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-626b186d-c4a5-4a6e-8b47-e1c958775edb admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011315 Oct 27 14:03:18.235368 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 33/65] 10.222.0.85 () {60 vars in 1282 bytes} [Wed Oct 27 14:03:18 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:03:18.248111 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-43ef2843-c1cd-441b-abad-9101f549fe52 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:03:18.256309 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-43ef2843-c1cd-441b-abad-9101f549fe52 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012181 Oct 27 14:03:18.256838 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 33/66] 10.222.0.85 () {60 vars in 1285 bytes} [Wed Oct 27 14:03:18 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:03:18.269848 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-3f44cde7-44ef-4cda-9736-8dcc923157cb admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:03:18.278125 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-3f44cde7-44ef-4cda-9736-8dcc923157cb admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011849 Oct 27 14:03:18.278646 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 34/67] 10.222.0.85 () {60 vars in 1285 bytes} [Wed Oct 27 14:03:18 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:03:18.290503 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-34d6c699-9bb3-4b59-a557-b2d5e4976510 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:03:18.298381 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-34d6c699-9bb3-4b59-a557-b2d5e4976510 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011194 Oct 27 14:03:18.298923 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 34/68] 10.222.0.85 () {60 vars in 1282 bytes} [Wed Oct 27 14:03:18 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:04:38.732272 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-0cf651a5-45db-45b0-a213-f8f5e0cd34c0 tempest-verify_tempest_config-1862515816 tempest-verify_tempest_config-1862515816-project] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:04:38.734245 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-0cf651a5-45db-45b0-a213-f8f5e0cd34c0 tempest-verify_tempest_config-1862515816 tempest-verify_tempest_config-1862515816-project] 10.222.0.85 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111045 Oct 27 14:04:38.734773 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 35/69] 10.222.0.85 () {58 vars in 1133 bytes} [Wed Oct 27 14:04:38 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:06:10.144119 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-34d6c699-9bb3-4b59-a557-b2d5e4976510 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:06:10.145184 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-34d6c699-9bb3-4b59-a557-b2d5e4976510 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 27 14:06:10.145585 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 35/70] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:06:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:06:10.414669 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-ee42d8c6-3cee-43dd-97f9-54075f6d758d admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:06:10.415860 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:06:10.415860 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: warnings.warn(msg) Oct 27 14:06:10.417397 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-ee42d8c6-3cee-43dd-97f9-54075f6d758d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:06:10.417832 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-ee42d8c6-3cee-43dd-97f9-54075f6d758d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:06:10.418607 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-ee42d8c6-3cee-43dd-97f9-54075f6d758d admin admin] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:06:10.419032 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-ee42d8c6-3cee-43dd-97f9-54075f6d758d admin admin] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:06:10.452663 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-ee42d8c6-3cee-43dd-97f9-54075f6d758d admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.161567 Oct 27 14:06:10.453250 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 36/71] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Oct 27 14:06:10 2021] GET /compute/v2.1/os-services => generated 791 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:06:11.930042 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-34d6c699-9bb3-4b59-a557-b2d5e4976510 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:06:11.931055 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-34d6c699-9bb3-4b59-a557-b2d5e4976510 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Oct 27 14:06:11.931509 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 36/72] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:06:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:06:12.135384 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-6c1480b7-5807-471a-8dac-f6264d7f26ff admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:06:12.136545 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:06:12.136545 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: warnings.warn(msg) Oct 27 14:06:12.138133 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-6c1480b7-5807-471a-8dac-f6264d7f26ff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:06:12.138602 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-6c1480b7-5807-471a-8dac-f6264d7f26ff admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:06:12.139423 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-6c1480b7-5807-471a-8dac-f6264d7f26ff admin admin] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:06:12.139849 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-6c1480b7-5807-471a-8dac-f6264d7f26ff admin admin] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:06:12.160038 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-6c1480b7-5807-471a-8dac-f6264d7f26ff admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081558 Oct 27 14:06:12.160633 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 37/73] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Oct 27 14:06:12 2021] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:06:24.032306 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-34d6c699-9bb3-4b59-a557-b2d5e4976510 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:06:24.033317 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-34d6c699-9bb3-4b59-a557-b2d5e4976510 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Oct 27 14:06:24.033721 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 37/74] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:06:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:06:24.231046 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-48fe6b94-d812-4b77-bcff-1ca49f2c4193 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:06:24.232249 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:06:24.232249 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: warnings.warn(msg) Oct 27 14:06:24.233765 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-48fe6b94-d812-4b77-bcff-1ca49f2c4193 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:06:24.234199 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-48fe6b94-d812-4b77-bcff-1ca49f2c4193 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:06:24.234998 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-48fe6b94-d812-4b77-bcff-1ca49f2c4193 admin admin] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:06:24.235438 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-48fe6b94-d812-4b77-bcff-1ca49f2c4193 admin admin] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:06:24.260834 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-48fe6b94-d812-4b77-bcff-1ca49f2c4193 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082808 Oct 27 14:06:24.261306 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 38/75] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Oct 27 14:06:24 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:06:25.703968 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: DEBUG nova.api.openstack.wsgi [None req-34d6c699-9bb3-4b59-a557-b2d5e4976510 admin admin] Calling method '>' {{(pid=100964) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:06:25.704962 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: INFO nova.api.openstack.requestlog [None req-34d6c699-9bb3-4b59-a557-b2d5e4976510 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 27 14:06:25.705362 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: [pid: 100964|app: 0|req: 38/76] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Oct 27 14:06:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:06:25.906954 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG nova.api.openstack.wsgi [None req-a4c4bd3b-d0c4-4e6d-abff-59d6123f25f2 admin admin] Calling method '>' {{(pid=100963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:06:25.908141 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:06:25.908141 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: warnings.warn(msg) Oct 27 14:06:25.909655 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-a4c4bd3b-d0c4-4e6d-abff-59d6123f25f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:06:25.910092 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-a4c4bd3b-d0c4-4e6d-abff-59d6123f25f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:06:25.910871 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-a4c4bd3b-d0c4-4e6d-abff-59d6123f25f2 admin admin] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:06:25.911320 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: DEBUG oslo_concurrency.lockutils [None req-a4c4bd3b-d0c4-4e6d-abff-59d6123f25f2 admin admin] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:06:25.933107 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: INFO nova.api.openstack.requestlog [None req-a4c4bd3b-d0c4-4e6d-abff-59d6123f25f2 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082204 Oct 27 14:06:25.933657 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: [pid: 100963|app: 0|req: 39/77] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Oct 27 14:06:25 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:07:25.841224 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: Wed Oct 27 14:07:25 2021 - graceful shutdown triggered... Oct 27 14:07:25.841462 dv-cinder-815660-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 14:07:25.842199 dv-cinder-815660-2-iscsi devstack@n-api.service[100963]: Gracefully killing worker 1 (pid: 100963)... Oct 27 14:07:25.843213 dv-cinder-815660-2-iscsi devstack@n-api.service[100964]: Gracefully killing worker 2 (pid: 100964)... Oct 27 14:07:26.842364 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: worker 1 buried after 1 seconds Oct 27 14:07:26.842828 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: worker 2 buried after 1 seconds Oct 27 14:07:26.842828 dv-cinder-815660-2-iscsi devstack@n-api.service[100962]: goodbye to uWSGI. Oct 27 14:07:26.843941 dv-cinder-815660-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 27 14:07:26.844520 dv-cinder-815660-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 14:07:26.847390 dv-cinder-815660-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 14:07:26.858063 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 27 14:07:26 2021] *** Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: nodename: dv-cinder-815660-2-iscsi Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: machine: x86_64 Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: clock source: unix Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: pcre jit disabled Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: detected number of CPU cores: 4 Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: current working directory: / Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: detected binary path: /usr/bin/uwsgi-core Oct 27 14:07:26.860688 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: your processes number limit is 47680 Oct 27 14:07:26.861528 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: your memory page size is 4096 bytes Oct 27 14:07:26.861528 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: detected max file descriptor number: 2048 Oct 27 14:07:26.861528 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: lock engine: pthread robust mutexes Oct 27 14:07:26.861528 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: thunder lock: enabled Oct 27 14:07:26.861528 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 14:07:26.861528 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 27 14:07:26.909737 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: Python main interpreter initialized at 0x55a17fd1f9c0 Oct 27 14:07:26.909737 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: python threads support enabled Oct 27 14:07:26.909737 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: your server socket listen backlog is limited to 100 connections Oct 27 14:07:26.909737 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: your mercy for graceful operations on workers is 90 seconds Oct 27 14:07:26.910151 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 14:07:26.910151 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: *** Operational MODE: preforking *** Oct 27 14:07:26.910394 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: *** uWSGI is running in multiple interpreter mode *** Oct 27 14:07:26.910394 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: spawned uWSGI master process (pid: 115910) Oct 27 14:07:26.910597 dv-cinder-815660-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 14:07:26.911203 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: spawned uWSGI worker 1 (pid: 115931, cores: 1) Oct 27 14:07:26.911708 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: spawned uWSGI worker 2 (pid: 115932, cores: 1) Oct 27 14:07:26.911991 dv-cinder-815660-2-iscsi devstack@n-api.service[115910]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 14:07:28.725617 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 14:07:28.725617 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: from cryptography.utils import int_from_bytes Oct 27 14:07:28.726494 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 14:07:28.726494 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: from cryptography.utils import int_from_bytes Oct 27 14:07:28.756353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 14:07:28.756353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: from cryptography.utils import int_from_bytes Oct 27 14:07:28.757057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 14:07:28.757057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: from cryptography.utils import int_from_bytes Oct 27 14:07:31.288510 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 14:07:31.289001 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 14:07:31.289254 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 14:07:31.289639 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 14:07:31.289885 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 14:07:31.290294 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.290627 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.290952 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.291313 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.291644 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.291959 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.292286 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.292607 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.292938 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.293198 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.293519 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.293842 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-2-iscsi {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.294162 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.294469 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.294780 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.295105 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.295440 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.295763 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.296069 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.296583 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.298021 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.298021 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.298021 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.298021 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.298369 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.298601 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.298875 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.299216 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.299545 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.300028 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.300608 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-2-iscsi {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.301085 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.301562 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.301885 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.302324 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.302626 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.302927 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.303896 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.304301 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.304640 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.304948 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.305267 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.305590 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.305908 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.306213 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.306616 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.306841 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.307194 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.307503 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.307807 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.308057 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.308362 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.308686 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.309008 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.309332 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.309585 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.309833 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.310158 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.310472 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.310779 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.311086 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.311421 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.311727 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.312032 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.312337 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.312641 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.312945 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.313265 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.313579 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.313900 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.314207 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.314524 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.314933 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.315204 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.315514 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.315860 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.316179 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.316496 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.316822 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.317141 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.317448 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.317754 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.318061 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.318379 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.318719 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.319661 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.319915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.320229 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.320529 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.320850 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.321156 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.321462 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.321770 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.322067 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.322378 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.322684 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.322986 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.323323 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.323632 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.323936 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.324244 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.324549 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.324854 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.325175 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.325551 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.325865 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.326099 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.327187 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.327187 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.327187 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.327438 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.327642 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.327956 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.328262 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.328567 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.328884 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.329191 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.329496 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.329813 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.330116 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.330421 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.330737 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.331043 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.331374 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.331681 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.331981 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.332281 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.332584 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.332883 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.333185 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.333484 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.333798 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.334118 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.334456 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.334761 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.335063 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.335409 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.335753 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.336081 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.336429 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.336844 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.337071 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.337402 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.337722 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.338034 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.338347 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.338673 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.338984 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.339319 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.339631 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.339950 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.340273 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.340602 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.340915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.341231 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.341546 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.341852 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.342168 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.342495 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.342819 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.343144 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.343655 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.343997 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.344268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 14:07:31.344747 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.344889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 14:07:31.345036 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.345036 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.345329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 14:07:31.345477 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.345618 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 14:07:31.345788 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.345944 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 14:07:31.346101 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.346277 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.346421 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.346557 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.346698 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.346848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.347013 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.347211 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.347305 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.347389 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.347484 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.347586 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.347701 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.347877 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.348017 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.348201 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.348323 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.348537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.348635 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.348803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.348919 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.349126 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.349230 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.349463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-2-iscsi {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.349561 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.349789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.349880 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.350130 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.350236 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.350449 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.350598 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.350775 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.350866 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.351081 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.351223 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.351434 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.351535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.351742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.351832 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.352046 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.352255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.352374 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.352572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.352671 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.352882 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.352996 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.353199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.353303 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.353541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.353633 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.353843 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.353942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.354161 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.354251 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.354465 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.354555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.354769 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.354870 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.355082 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.355209 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.355426 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.355515 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.355736 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.355829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-2-iscsi {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.356048 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.356144 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.356372 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.356477 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.356689 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.356792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.357004 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.357140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.357340 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.357461 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.357673 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.357776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.357979 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.358080 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.358303 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.358410 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.358633 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.358727 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.358951 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.359054 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.359285 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.359378 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.359583 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.359689 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.359887 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.359980 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.360190 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.360293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.360495 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.360605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.360805 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.360905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.361106 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.361213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.361416 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.361520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.361719 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.361915 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.362023 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.362175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.362310 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.362494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.362623 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.362910 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.363011 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.363171 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.363267 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.363495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.363611 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.363747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.363866 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.364053 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.364153 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.364319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.364442 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.364645 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.364777 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.364959 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.365096 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.365277 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.365462 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.365578 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.366291 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.366559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.366691 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.366873 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.366981 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.367246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.367352 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.367525 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.367633 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.367836 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.367941 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.368144 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.368251 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.368469 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.368562 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.368785 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.368888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.369097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.369196 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.369407 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.369504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.369732 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.369831 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.370045 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.370145 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.370368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.370458 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.370672 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.370779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.370989 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.371082 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.371350 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.371452 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.371678 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.371782 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.372262 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.372358 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.372574 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.372664 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.372886 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.372986 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.373199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.373312 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.373952 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.374073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.374170 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.374271 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.374357 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.374463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.374463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.374627 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.374720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.374815 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.374995 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.375113 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.375344 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.375438 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.375655 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.375746 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.375968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.376059 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.376276 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.376380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.376582 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.376678 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.376894 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.376992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.377206 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.377304 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.377525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.377652 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.377831 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.377924 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.378144 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.378271 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.378455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.378548 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.378767 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.378859 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.379077 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.379343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.379441 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.379527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.379710 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.379807 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.380014 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.380107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.380319 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.380412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.380627 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.380719 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.380938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.381029 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.381270 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.381410 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.382311 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.382418 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.382634 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.382726 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.382952 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.383052 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.383292 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.383385 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.383604 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.383696 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.383910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.384015 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.384227 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.384328 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.384542 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.384633 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.384853 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.384963 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.385179 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.385285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.385482 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.385576 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.385790 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.387385 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.387482 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.387571 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.387763 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.387852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.387937 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.388011 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.388090 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.388162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.388162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.388297 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.388297 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.388441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.388441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.388575 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.388655 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.388734 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.388734 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.388877 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.388954 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.389108 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.389198 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.389446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.389528 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.389765 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.389852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.390078 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.390169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.390389 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.390477 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.390699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.390786 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.391016 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.391116 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:07:31.391352 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.391666 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.391885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.391970 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.392275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.392367 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.392583 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.392664 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.392907 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.392997 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.393217 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.393312 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.393575 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.393676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.393839 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.393920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.394143 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.394319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.394483 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.394707 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.394865 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.395065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.395396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.395508 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.395749 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.395917 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.396069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.396166 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.396355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.396456 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.396681 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.396784 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.397576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.397789 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.397903 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.398077 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.398213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.398714 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.398714 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.399015 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.399202 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.399347 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.399438 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.399438 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.399591 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.399745 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.399852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.400057 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.400157 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.400366 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.400489 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.400671 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.400977 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.401456 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.401559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.401648 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.402428 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.402545 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.402624 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.402624 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.402825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.402919 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.403001 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.403079 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.403470 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.403585 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.403716 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.404058 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.404159 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.404253 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.404336 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.404644 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.404779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.404936 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.405110 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.405240 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.405676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.405881 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.406070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.406251 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.406424 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.406535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.406663 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.407003 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.407174 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.407337 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.407446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.407645 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.407794 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.407989 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.408092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.408278 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.408409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.408582 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.408675 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.408886 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.408979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.409196 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.409288 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.409503 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.409611 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.409806 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.409906 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.410116 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.410253 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.410425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.410518 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.410736 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.410837 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.411044 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.411175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.411371 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.411494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.411679 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.411772 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.411984 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.412089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.412293 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.412400 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.413229 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.413334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.413539 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.413762 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.414006 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.414174 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.414321 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.414420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.414631 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.414792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.414939 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.415083 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.415274 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.415379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.415654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.415818 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.415969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.416121 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.416270 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.416437 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.416598 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.416736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.416886 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.417029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.417180 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.417342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.417476 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.417626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.417777 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.417927 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.418067 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.418214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.418367 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.418530 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.418685 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.418826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.418965 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.419159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.419306 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.419488 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.419638 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.419805 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.419954 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.420124 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.420268 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.420430 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.420571 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.420735 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.420876 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.421045 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.421187 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.421411 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.421551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.421692 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.421836 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.421975 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.422159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.422318 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.422473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.422611 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.422700 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.422832 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.422931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.423090 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.423257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.423450 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.423552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.423722 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.423831 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.424022 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.424121 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.424346 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.424439 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.424654 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.424759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.424957 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.425114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.425262 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.425354 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.425586 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.425701 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.425932 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.426055 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.426235 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.426351 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.426599 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.426736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.426904 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.427006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.427242 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.427348 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.427565 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.427879 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.428231 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.428520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.428644 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.428897 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.429011 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.429157 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.429306 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.429470 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.429608 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.429783 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.429932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.430084 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.430267 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.430374 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.430595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.430728 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.430937 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.431046 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.431288 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.431403 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.431626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.431807 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.431948 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.432083 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.432416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.432771 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.433125 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.433374 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.433473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.433700 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.433801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.434027 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.434133 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.434353 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.434454 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.434676 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.434785 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.435000 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.435769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.436099 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.436374 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.436529 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.436688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.436852 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.437358 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.437509 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.437601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.437695 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.437782 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.437872 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.437971 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.438174 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.438314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.438451 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.438542 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.438633 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.438728 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.438814 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.438897 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.438981 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.439071 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.439249 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.439352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.439439 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.439522 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.439605 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.439695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.439793 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.439903 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.440002 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.440273 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.440384 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.440543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.440648 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.440861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.440960 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.441182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.441274 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.441495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.441600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.441807 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.441906 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.442124 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.442225 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.442447 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.442550 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.442776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.442869 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.443064 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.443183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.443417 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.443521 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.444267 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.444374 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.444718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.444810 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.445042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.445189 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.445446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.445553 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.445679 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.445824 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.445969 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.446085 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.446300 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.446420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.446612 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.446752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.446921 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.447037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.447297 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.447446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.447548 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.447634 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.447877 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.447991 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.448195 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.448312 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.448509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.448629 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.448821 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.448921 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.449206 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.449309 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.449479 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.449611 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.449865 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.449970 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.450099 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.450252 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.450420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.450528 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.450859 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.450967 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.451209 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.451326 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.451521 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.451625 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.451839 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.451931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.452152 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.452245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.452478 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.452573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.452802 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.452905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.453116 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.453216 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.453433 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.453526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.453739 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.453833 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.454065 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.454158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.454390 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.454483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.454705 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.454797 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.455031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.455122 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.455377 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.455493 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.455699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.455823 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.456014 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.456142 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.456340 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.456489 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.456669 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.456796 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.457116 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.457248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.457421 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.457747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.457850 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.457934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.458081 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.458414 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.458739 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.459043 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.459265 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.459440 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.460346 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.460451 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.460680 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.460793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.461020 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.461126 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.461346 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.461452 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.461663 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.461761 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.461984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.462080 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.462317 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.462423 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.462606 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.462718 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.462924 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.463043 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.463281 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.463464 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.463642 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.463805 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.463956 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.464117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.464275 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.464433 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.464593 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.464739 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.464883 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.465042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.465188 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.465342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.465486 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.465630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.465774 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.465938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.466091 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.466235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.466398 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.466578 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.466844 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.467204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.467360 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.467507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.467668 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.467814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.467957 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.468101 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.468251 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.468395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.468565 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.468803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.468960 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.469115 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.469261 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.469404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.469573 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.469728 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.469880 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.470024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.470175 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.470329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.470474 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.470626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.470780 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.470924 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.471077 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.471279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.471428 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.471579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.471732 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.471884 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.472028 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.472191 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.472344 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.472496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.472683 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.472914 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.473076 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.473236 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.473388 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.473540 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.473685 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.473828 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.473981 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.474125 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.474278 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.474429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.474580 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.474743 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.474897 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.475123 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.475376 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.475538 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.475684 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.475829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.475983 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.476128 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.476271 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.476423 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.476573 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.476717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.476978 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.477157 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.477393 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.477550 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.477695 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.477848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.478002 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.478147 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.478291 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.478434 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.478584 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.478737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.478978 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.479217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.479411 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.479561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.479704 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.479864 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.480010 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.480152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.480295 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.480437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.480587 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.480744 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.480888 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.481079 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.481079 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.481365 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.481510 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.481666 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.481811 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.481963 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.482108 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.482251 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.482469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.482615 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.482759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.482920 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.483181 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.483349 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.483509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.483655 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.483800 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.483951 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.484096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.484247 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.484406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.484557 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.484702 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.484852 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.485009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.485172 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.485319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.485462 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.485606 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.485749 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.485893 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.486048 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.486195 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.486347 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.486528 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.486684 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.486829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.487013 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.487273 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.487273 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.487730 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.487888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.488032 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.488183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.488328 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.488481 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.488632 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.488786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.488947 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.489199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.489362 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.489509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.489661 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.489661 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.489940 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.490092 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.490244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.490397 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.490552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.490752 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.490967 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.491314 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.491490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.491645 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.491801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.491946 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.492090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.492271 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.492419 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.492577 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.492730 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.492873 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.493023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.493193 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.493442 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.493610 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.493868 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.494067 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.494233 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.494233 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.494511 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.494666 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.494811 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.494954 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.495097 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.495275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.495422 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.495624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.495784 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.495934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.496088 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.496240 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.496397 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.496542 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.496685 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.496838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.497252 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.497489 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.497669 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.497913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.498086 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.498232 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.498383 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.498534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.498688 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.498833 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.498991 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.499281 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.499448 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.499657 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.499814 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.499969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.500128 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.500280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.500425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.500568 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.500568 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.500861 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.501014 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.501167 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.501318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.501473 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.501625 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.501779 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.501931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.502088 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.502241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.502399 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.502543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.502695 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.502846 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.502998 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.503162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.503331 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.503331 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.503728 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.503893 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.504039 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.504207 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.504359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.504504 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.504648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.504791 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.504942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.505166 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.505321 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.505465 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.505616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.505768 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.505919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.506072 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.506773 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.507013 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.507224 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.507378 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.507617 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.507782 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.507954 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.508191 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.508341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.508493 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.508658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.508826 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.508990 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.509148 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.509319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.509560 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.509731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.509890 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.510048 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.510207 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.510365 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.510524 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.510689 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.510840 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.510990 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.511171 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.511329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.511481 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.511643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.511837 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.511992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.512142 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.512142 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.512446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.512607 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.512757 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.512907 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.513064 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.513227 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.513387 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.513565 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.513801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.513967 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.514119 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.514276 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.514441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.514593 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.514752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.514908 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.515059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.515266 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.515440 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.515591 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.515749 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.515901 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.516050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.516050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.516350 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.516514 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.516665 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.516823 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.516973 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.517137 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.517306 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.517457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.517627 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.517856 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.518012 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.518194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.518444 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.518608 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.518770 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.518770 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.519080 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.519270 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.519425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.519678 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.519844 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.519997 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.520161 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.520313 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.520470 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.520620 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.520770 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.520921 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.521081 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.521233 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.521397 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.521549 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.521710 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.521907 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.522602 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.522806 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.522969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.523315 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.523478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.523652 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.523835 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.524074 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.524231 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.524382 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.524546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.524708 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.524868 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.525026 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.525178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.525336 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.525487 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.525650 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.525801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.525960 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.526118 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.526270 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.526432 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.526598 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.526748 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.526906 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.527057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.527057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.527386 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.527545 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.527703 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.527964 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.528122 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.528276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.528453 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.528722 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.528889 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.529041 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.529192 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.529350 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.529511 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.529691 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.529926 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.530083 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.530234 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.530234 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.530545 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.530703 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.530872 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.531032 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.531211 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.531384 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.531543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.531695 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.531846 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.532004 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.532154 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.532360 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.532523 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.532674 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.532835 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.532986 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.533146 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.533298 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.533455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.533613 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.533764 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.533915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.534092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.534321 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.534476 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.534635 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.534794 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.534968 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.535169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.535342 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.535493 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.535645 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.535794 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.535995 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.536170 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.536323 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.536473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.536625 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.536782 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.536942 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.537106 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.537263 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.537421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.538239 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.538493 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.538751 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.539009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.539219 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.539380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.539539 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.539699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.539862 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.540118 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.540285 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.540444 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.540596 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.540746 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.540976 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.541138 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.541391 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.541552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.541704 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.541874 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.542027 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.542185 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.542356 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.542508 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.542665 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.542825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.542986 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.543155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.543324 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.543483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.543634 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.543634 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.543973 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.544128 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.544308 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.544549 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.544705 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.544869 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.545022 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.545173 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.545324 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.545474 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.545639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.545798 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.545949 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.546100 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.546100 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.546406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.546574 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.546733 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.546886 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.547037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.547206 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 14:07:31.547364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.547364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.547364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.547364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.547364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.547364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.547364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.547364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.548703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.548703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.548703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.548703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.548703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.548703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.548703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.548703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.549970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.549970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.549970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.549970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.549970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.549970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.549970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.551221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.551221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.551221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.551221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.551221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.551221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.552088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.552088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.552413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.552413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.552745 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.553064 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.554002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.554753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.555006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.555393 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.555733 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.556069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.556399 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.556731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.557072 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.557392 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.557762 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.558019 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.558380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.558644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.558975 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.559331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.559629 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.559985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.560275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.560825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.561253 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.561499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.561826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.562159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.562483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.562799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.563273 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.563518 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.563815 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.564112 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.564436 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.564752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.565151 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.565378 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.565669 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.565982 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.566301 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.566614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.566812 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_db.sqlalchemy.engines [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 14:07:31.567019 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.567282 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.567569 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.567950 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.568196 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.568532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.569351 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.569731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.569963 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.572957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.572957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.572957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.572957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.572957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.572957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.572957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.572957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.574293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.574293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.574293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.574293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.574293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.574293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.575342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.575342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.575342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.575782 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.576150 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.576552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.576886 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.577245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.577720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.577913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.578229 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.578518 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.578849 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.579187 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.579512 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.579836 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.580152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.580479 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.580797 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.581117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.581437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.581758 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.582112 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.582440 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.582765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.583093 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.583442 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.583764 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.584084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.584447 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.585403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.585616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.585960 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.586279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.586595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.587038 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.587383 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.587710 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.588038 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.588357 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.588685 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.589017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.589337 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.589667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.589984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.590322 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.590670 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.591008 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.591367 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.591682 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.591994 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.592304 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.592620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.592959 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.593286 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.593614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.593932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.594260 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.594577 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.594902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.595253 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.595583 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.595898 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.596238 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.596554 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.596871 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.597189 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.597520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.597820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.598140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.598557 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.598802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.599117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.599485 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.599814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.600786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.601183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.601440 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.601782 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.602103 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.602431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.602751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.603072 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.603426 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.603750 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.604083 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.604415 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.604751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.605085 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.605439 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.605763 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.606114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.606449 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:07:31.606697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 14:07:31.633430 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 14:07:31.650504 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.context [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c89c5998-b04c-4a8a-a40e-c04db17dd463(cell1) {{(pid=115932) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 14:07:31.654970 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:07:31.656556 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:07:31.657374 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:07:31.659348 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:07:31.672776 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_db.sqlalchemy.engines [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 14:07:31.673610 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_db.sqlalchemy.engines [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 14:07:31.716977 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.context [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c89c5998-b04c-4a8a-a40e-c04db17dd463(cell1) {{(pid=115931) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 14:07:31.721404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:07:31.722983 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:07:31.723829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:07:31.725898 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:07:31.736593 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 14:07:31.737441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 14:07:31.941555 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_db.sqlalchemy.engines [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 14:07:32.002032 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 14:07:32.265722 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: WARNING keystonemiddleware.auth_token [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 14:07:32.272386 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: WARNING keystonemiddleware.auth_token [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 14:07:32.328822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: WARNING keystonemiddleware.auth_token [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 14:07:32.335679 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: WARNING keystonemiddleware.auth_token [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 14:07:32.621427 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: WARNING keystonemiddleware.auth_token [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 14:07:32.626981 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: WARNING keystonemiddleware.auth_token [None req-3202b656-a5e2-4e1a-9655-5d87ff868d5e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 14:07:32.632189 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a17fd1f9c0 pid: 115932 (default app) Oct 27 14:07:32.687381 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: WARNING keystonemiddleware.auth_token [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 14:07:32.692767 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: WARNING keystonemiddleware.auth_token [None req-6fb35a77-69cc-4cbf-9e4b-9f71156bc5c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 14:07:32.697958 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a17fd1f9c0 pid: 115931 (default app) Oct 27 14:08:06.704966 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-386cb869-7e14-43eb-8f9a-797e8a6e1847 tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] Action: 'create', calling method: .version_select at 0x7f4571dd8f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1164942162", "metadata": {"Type": "work"}}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:06.714734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-743de188-8d31-473b-a951-ab5b63876d12 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Action: 'create', calling method: .version_select at 0x7f4571e55f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-709224681", "metadata": {"Type": "work"}}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:06.717129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-743de188-8d31-473b-a951-ab5b63876d12 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:08:06.718235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-743de188-8d31-473b-a951-ab5b63876d12 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.493184 Oct 27 14:08:06.724574 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 1/1] 10.222.0.85 () {60 vars in 1155 bytes} [Wed Oct 27 14:08:06 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 500 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 14:08:06.746950 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2a001e3f-fc37-4cfe-9ef4-9bf25dc24267 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Action: 'create', calling method: .version_select at 0x7f4571dffaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-135480568", "metadata": {"Type": "work"}}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:06.748735 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2a001e3f-fc37-4cfe-9ef4-9bf25dc24267 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:08:06.749646 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2a001e3f-fc37-4cfe-9ef4-9bf25dc24267 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018908 Oct 27 14:08:06.754640 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 2/2] 10.222.0.85 () {60 vars in 1155 bytes} [Wed Oct 27 14:08:06 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 14:08:06.765997 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bb4b4e63-09de-47f4-92c0-860fe8bfb3b2 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Action: 'create', calling method: .version_select at 0x7f4571e558b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1881557685", "metadata": {"Type": "work"}}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:06.767506 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bb4b4e63-09de-47f4-92c0-860fe8bfb3b2 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:08:06.768690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bb4b4e63-09de-47f4-92c0-860fe8bfb3b2 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012857 Oct 27 14:08:06.769766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 3/3] 10.222.0.85 () {60 vars in 1155 bytes} [Wed Oct 27 14:08:06 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 14:08:06.811940 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-eb09f5f1-eb3b-4042-b09a-49e6ea2bdf4b tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Calling method '.version_select at 0x7f4571d19a60>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:07.059721 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-eb09f5f1-eb3b-4042-b09a-49e6ea2bdf4b tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] HTTP exception thrown: Volume tempest-invalid-659238904 could not be found. Oct 27 14:08:07.060460 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-eb09f5f1-eb3b-4042-b09a-49e6ea2bdf4b tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Returning 404 to user: Volume tempest-invalid-659238904 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:08:07.061522 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-eb09f5f1-eb3b-4042-b09a-49e6ea2bdf4b tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/tempest-invalid-659238904" status: 404 len: 98 microversion: 2.1 time: 0.278922 Oct 27 14:08:07.062226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 4/4] 10.222.0.85 () {58 vars in 1214 bytes} [Wed Oct 27 14:08:06 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-659238904 => generated 98 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 14:08:07.071659 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fff4e9a8-a872-4649-ab67-8f8e074eeee5 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003959 Oct 27 14:08:07.072428 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 5/5] 10.222.0.85 () {58 vars in 1139 bytes} [Wed Oct 27 14:08:07 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 27 14:08:07.081059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b807b565-1cd1-484e-ab2a-1611a51d4ace tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003626 Oct 27 14:08:07.082060 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 6/6] 10.222.0.85 () {58 vars in 1136 bytes} [Wed Oct 27 14:08:07 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 14:08:07.091372 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c81cbe27-1601-4069-a716-923783f01216 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Calling method '.version_select at 0x7f4571ccd0d0>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:07.151290 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-c81cbe27-1601-4069-a716-923783f01216 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] HTTP exception thrown: Volume 6009d4d4-f0a5-480b-8fc8-9cf88d6b8986 could not be found. Oct 27 14:08:07.151949 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c81cbe27-1601-4069-a716-923783f01216 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Returning 404 to user: Volume 6009d4d4-f0a5-480b-8fc8-9cf88d6b8986 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:08:07.152984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c81cbe27-1601-4069-a716-923783f01216 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/6009d4d4-f0a5-480b-8fc8-9cf88d6b8986" status: 404 len: 109 microversion: 2.1 time: 0.065057 Oct 27 14:08:07.153486 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 7/7] 10.222.0.85 () {58 vars in 1247 bytes} [Wed Oct 27 14:08:07 2021] DELETE /compute/v2.1/os-volumes/6009d4d4-f0a5-480b-8fc8-9cf88d6b8986 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:08:07.158437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-35608917-c1b9-4ec8-b37f-3968c8f993ba tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f4571cbad30>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:07.230528 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-35608917-c1b9-4ec8-b37f-3968c8f993ba tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/d4020143-bc4f-4158-bdaa-83ed58f5e881" status: 200 len: 351 microversion: 2.1 time: 0.075914 Oct 27 14:08:07.231323 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 8/8] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:08:07 2021] GET /compute/v2.1/os-volumes/d4020143-bc4f-4158-bdaa-83ed58f5e881 => generated 351 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:07.236624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cb155001-cdf5-4546-80a0-834b0317ea60 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Calling method '.version_select at 0x7f4571ccd280>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:07.411252 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-cb155001-cdf5-4546-80a0-834b0317ea60 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] HTTP exception thrown: Volume c683c10b-0730-4901-80a0-9d0b6dbb5b46 could not be found. Oct 27 14:08:07.412056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cb155001-cdf5-4546-80a0-834b0317ea60 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] Returning 404 to user: Volume c683c10b-0730-4901-80a0-9d0b6dbb5b46 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:08:07.413549 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cb155001-cdf5-4546-80a0-834b0317ea60 tempest-VolumesNegativeTest-1215840140 tempest-VolumesNegativeTest-1215840140-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/c683c10b-0730-4901-80a0-9d0b6dbb5b46" status: 404 len: 109 microversion: 2.1 time: 0.180305 Oct 27 14:08:07.414596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 9/9] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:08:07 2021] GET /compute/v2.1/os-volumes/c683c10b-0730-4901-80a0-9d0b6dbb5b46 => generated 109 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:08:07.461941 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-386cb869-7e14-43eb-8f9a-797e8a6e1847 tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.242131 Oct 27 14:08:07.462810 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 1/10] 10.222.0.85 () {60 vars in 1155 bytes} [Wed Oct 27 14:08:06 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1245 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 14:08:07.477536 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6a064ac5-c665-4b78-babe-6432cbc03c2d tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] Calling method '.version_select at 0x7f4571c5aa60>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:07.579713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6a064ac5-c665-4b78-babe-6432cbc03c2d tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104" status: 200 len: 353 microversion: 2.1 time: 0.107492 Oct 27 14:08:07.580617 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 10/11] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:08:07 2021] GET /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:07.855521 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-234454529", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "networks": [{"uuid": "9287d5f3-a99c-4613-b3ac-b9bc822802a7"}]}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:08.041256 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.network.neutron [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] validate_networks() for [('9287d5f3-a99c-4613-b3ac-b9bc822802a7', None, None, None, None, None)] {{(pid=115932) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:08:08.594025 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-231506bf-8452-4364-9e31-d884d8d8b70a tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] Calling method '.version_select at 0x7f4571ccd670>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:08.667476 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-231506bf-8452-4364-9e31-d884d8d8b70a tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104" status: 200 len: 354 microversion: 2.1 time: 0.078113 Oct 27 14:08:08.668555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 11/12] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:08:08 2021] GET /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104 => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:08.686552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e19e9d4b-92a3-4eb8-a5a3-9d99d93def9f tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] Calling method '.version_select at 0x7f4571c5a790>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:08.750393 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e19e9d4b-92a3-4eb8-a5a3-9d99d93def9f tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104" status: 200 len: 354 microversion: 2.1 time: 0.072520 Oct 27 14:08:08.750905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 12/13] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:08:08 2021] GET /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104 => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:08.768051 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bf1d387d-bc8d-4da6-9ff0-194b9bd60b45 tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] Calling method '.version_select at 0x7f4571c5adc0>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:08.864964 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bf1d387d-bc8d-4da6-9ff0-194b9bd60b45 tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104" status: 202 len: 0 microversion: 2.1 time: 0.100607 Oct 27 14:08:08.866778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 13/14] 10.222.0.85 () {58 vars in 1247 bytes} [Wed Oct 27 14:08:08 2021] DELETE /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:08:08.878409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7ffb5a49-ae86-4af2-948c-ba285f64bbe3 tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] Calling method '.version_select at 0x7f4571c5a4c0>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:08.971546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7ffb5a49-ae86-4af2-948c-ba285f64bbe3 tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104" status: 200 len: 353 microversion: 2.1 time: 0.100570 Oct 27 14:08:08.972621 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 14/15] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:08:08 2021] GET /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:08:09.049234 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-66513639-88c5-4c3b-a48c-c456c5d5af67 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f4571cbad30>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:09.130934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-66513639-88c5-4c3b-a48c-c456c5d5af67 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/92893980-37f0-41b5-a564-a818117d178a" status: 200 len: 350 microversion: 2.1 time: 0.086317 Oct 27 14:08:09.131582 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 15/16] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:08:09 2021] GET /compute/v2.1/os-volumes/92893980-37f0-41b5-a564-a818117d178a => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:08:09.396028 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-292604289", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "networks": [{"uuid": "5b53c648-0313-4179-8334-9fa5d1933987"}]}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:09.619657 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Flavor limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:08:09.621634 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Image limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:08:09.622971 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Flavor pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:08:09.623833 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Image pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:08:09.624464 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:08:09.681194 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:09.681842 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:09.682790 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:09.683421 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:09.750377 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Getting quotas for project fef26a68103c41df95d4610911087640. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:08:09.761296 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Getting quotas for user 8a825da5391d48679f6b82d48b94d26e and project fef26a68103c41df95d4610911087640. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:08:09.783392 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Going to run 1 instances... {{(pid=115932) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:08:09.787452 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:08:09.839381 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] validate_networks() for [('5b53c648-0313-4179-8334-9fa5d1933987', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:08:09.961895 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-eaba6490-0bff-41f6-912a-287d5b6d96ff tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.268943 Oct 27 14:08:09.965483 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 2/17] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:08:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:08:09.989438 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-20876c99-96a1-4df6-87bc-04f31dad5d06 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:09.993401 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-20876c99-96a1-4df6-87bc-04f31dad5d06 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:10.237936 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-20876c99-96a1-4df6-87bc-04f31dad5d06 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:10.288905 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-20876c99-96a1-4df6-87bc-04f31dad5d06 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1214 microversion: 2.1 time: 0.303797 Oct 27 14:08:10.301391 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 3/18] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:09 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1214 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:10.309288 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-bf8a3ffe-36c7-4390-98e0-89c11639acbf tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] Calling method '.version_select at 0x7f4571bcba60>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:10.370704 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-bf8a3ffe-36c7-4390-98e0-89c11639acbf tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] HTTP exception thrown: Volume 36904b80-ce60-4bf2-b93b-5d3eb91e0104 could not be found. Oct 27 14:08:10.371727 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-bf8a3ffe-36c7-4390-98e0-89c11639acbf tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] Returning 404 to user: Volume 36904b80-ce60-4bf2-b93b-5d3eb91e0104 could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:08:10.372638 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-bf8a3ffe-36c7-4390-98e0-89c11639acbf tempest-VolumesGetTestJSON-410386947 tempest-VolumesGetTestJSON-410386947-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104" status: 404 len: 109 microversion: 2.1 time: 0.069509 Oct 27 14:08:10.373881 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 4/19] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:08:10 2021] GET /compute/v2.1/os-volumes/36904b80-ce60-4bf2-b93b-5d3eb91e0104 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:08:10.821981 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0946427f-5ffb-4564-9ff2-1b72b2e9bf48 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f457264b430>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:10.948317 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0946427f-5ffb-4564-9ff2-1b72b2e9bf48 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/3a2d4072-ef8d-48a7-8931-2d745a35fa71" status: 200 len: 350 microversion: 2.1 time: 0.135379 Oct 27 14:08:10.948965 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 5/20] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:08:10 2021] GET /compute/v2.1/os-volumes/3a2d4072-ef8d-48a7-8931-2d745a35fa71 => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:08:10.961566 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b1564da6-905c-49ad-9a2c-0948ccda19f8 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f4571bcb790>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:11.172060 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b1564da6-905c-49ad-9a2c-0948ccda19f8 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.214947 Oct 27 14:08:11.172643 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 6/21] 10.222.0.85 () {58 vars in 1133 bytes} [Wed Oct 27 14:08:10 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:11.184691 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f2a7c6c8-ce4a-493f-ac55-754299ad76a5 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f4570b6e5e0>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:11.415429 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f2a7c6c8-ce4a-493f-ac55-754299ad76a5 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.234103 Oct 27 14:08:11.423647 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 7/22] 10.222.0.85 () {58 vars in 1148 bytes} [Wed Oct 27 14:08:11 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:11.423647 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-9a549ac8-5ee8-447d-ad59-0e32ff4173aa tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:11.424397 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-9a549ac8-5ee8-447d-ad59-0e32ff4173aa tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:11.595374 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-9a549ac8-5ee8-447d-ad59-0e32ff4173aa tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:11.607931 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-9a549ac8-5ee8-447d-ad59-0e32ff4173aa tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1214 microversion: 2.1 time: 0.186905 Oct 27 14:08:11.607931 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 8/23] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:11 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:11.623702 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-fa66b2bc-08c3-488c-898f-ff5deb6c1df8 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f457264b550>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:11.916336 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-fa66b2bc-08c3-488c-898f-ff5deb6c1df8 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.307985 Oct 27 14:08:11.917008 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 9/24] 10.222.0.85 () {58 vars in 1133 bytes} [Wed Oct 27 14:08:11 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:11.931402 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7c79aa7e-78e5-448d-8336-e4130d661b66 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f4570b180d0>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:12.050732 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7c79aa7e-78e5-448d-8336-e4130d661b66 tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.124265 Oct 27 14:08:12.061681 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 10/25] 10.222.0.85 () {58 vars in 1166 bytes} [Wed Oct 27 14:08:11 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:12.070263 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-89d43ee1-f4b2-42f6-a5ac-aa439a2311ff tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f4570b1eca0>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:12.193744 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-89d43ee1-f4b2-42f6-a5ac-aa439a2311ff tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.127716 Oct 27 14:08:12.207982 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 11/26] 10.222.0.85 () {58 vars in 1169 bytes} [Wed Oct 27 14:08:12 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:12.214241 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d2d18c21-e86e-4ba4-8365-6ad1b6f7c24a tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f4570b1e550>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:12.440119 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d2d18c21-e86e-4ba4-8365-6ad1b6f7c24a tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.230603 Oct 27 14:08:12.451421 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 12/27] 10.222.0.85 () {58 vars in 1154 bytes} [Wed Oct 27 14:08:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:12.462779 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-01157522-2703-40c6-b127-b07c37eb3d6a tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f4570b18550>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:12.726545 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-01157522-2703-40c6-b127-b07c37eb3d6a tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.268659 Oct 27 14:08:12.737495 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 13/28] 10.222.0.85 () {58 vars in 1187 bytes} [Wed Oct 27 14:08:12 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:08:12.745853 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d44cfdb4-f865-4ba9-ac91-2509d77742b9 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:12.746833 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d44cfdb4-f865-4ba9-ac91-2509d77742b9 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:12.776643 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d44cfdb4-f865-4ba9-ac91-2509d77742b9 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:12.777111 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d44cfdb4-f865-4ba9-ac91-2509d77742b9 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:12.785454 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d44cfdb4-f865-4ba9-ac91-2509d77742b9 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:12.786186 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d44cfdb4-f865-4ba9-ac91-2509d77742b9 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:12.821292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:08:12.821919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:08:12.822220 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:08:12.822703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:08:12.823213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:08:12.891696 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:12.896280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:12.904413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:12.911059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:13.034013 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Getting quotas for project a55431e3db544b7980c81c6303d1e8b2. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:08:13.057466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Getting quotas for user 3e59b470cb41474bb92d7e1049d02e6f and project a55431e3db544b7980c81c6303d1e8b2. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:08:13.096207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:08:13.107022 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:08:13.390297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-afe68f7c-bcb5-444f-861e-382cce7c4dbc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.219706 Oct 27 14:08:13.390953 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 16/29] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:08:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 4221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 14:08:13.397968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e93b86b6-4e10-441c-9dfb-11ef295ed29a tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] Calling method '.version_select at 0x7f4571bc7550>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:13.538629 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-d44cfdb4-f865-4ba9-ac91-2509d77742b9 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:13.578909 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d44cfdb4-f865-4ba9-ac91-2509d77742b9 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1210 microversion: 2.1 time: 0.835538 Oct 27 14:08:13.583878 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 14/30] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:12 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1210 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:13.611588 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a284de66-08a8-4565-9260-9c347406ef4c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:13.614516 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e93b86b6-4e10-441c-9dfb-11ef295ed29a tempest-VolumesTestJSON-1245293476 tempest-VolumesTestJSON-1245293476-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.222300 Oct 27 14:08:13.615100 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 17/31] 10.222.0.85 () {58 vars in 1154 bytes} [Wed Oct 27 14:08:13 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:13.616686 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a284de66-08a8-4565-9260-9c347406ef4c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:14.066737 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a284de66-08a8-4565-9260-9c347406ef4c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:14.079741 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a284de66-08a8-4565-9260-9c347406ef4c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1217 microversion: 2.1 time: 0.490578 Oct 27 14:08:14.080399 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 15/32] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:13 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1217 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:14.607885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8e97d42b-e156-4335-91da-e8bf24f3b443 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:14.609221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8e97d42b-e156-4335-91da-e8bf24f3b443 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:14.677185 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8e97d42b-e156-4335-91da-e8bf24f3b443 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:14.680175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8e97d42b-e156-4335-91da-e8bf24f3b443 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:14.683866 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8e97d42b-e156-4335-91da-e8bf24f3b443 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:14.684355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8e97d42b-e156-4335-91da-e8bf24f3b443 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:15.102524 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-9b936404-e928-4f62-8e8a-b248f1bce31b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:15.103987 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-9b936404-e928-4f62-8e8a-b248f1bce31b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:15.669776 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-9b936404-e928-4f62-8e8a-b248f1bce31b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:15.679849 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-9b936404-e928-4f62-8e8a-b248f1bce31b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1217 microversion: 2.1 time: 0.582379 Oct 27 14:08:15.680436 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 16/33] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:15 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1217 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:15.979417 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8e97d42b-e156-4335-91da-e8bf24f3b443 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:16.008203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8e97d42b-e156-4335-91da-e8bf24f3b443 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1272 microversion: 2.1 time: 1.404395 Oct 27 14:08:16.020677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 18/34] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:14 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1272 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:16.716010 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-cac752be-99d3-4cc7-aa52-edbe1d747ae9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:16.717744 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-cac752be-99d3-4cc7-aa52-edbe1d747ae9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:16.746496 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-cac752be-99d3-4cc7-aa52-edbe1d747ae9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:16.747845 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-cac752be-99d3-4cc7-aa52-edbe1d747ae9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:16.752756 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-cac752be-99d3-4cc7-aa52-edbe1d747ae9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:16.754235 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-cac752be-99d3-4cc7-aa52-edbe1d747ae9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:16.967024 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-cac752be-99d3-4cc7-aa52-edbe1d747ae9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:16.985092 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-cac752be-99d3-4cc7-aa52-edbe1d747ae9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1269 microversion: 2.1 time: 0.273486 Oct 27 14:08:16.989226 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 17/35] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:16 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1269 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:17.028883 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-346ed021-707f-4b56-88fa-ae4fa96b794b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:17.029784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-346ed021-707f-4b56-88fa-ae4fa96b794b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:17.065392 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-346ed021-707f-4b56-88fa-ae4fa96b794b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:17.066240 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-346ed021-707f-4b56-88fa-ae4fa96b794b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:17.066756 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-346ed021-707f-4b56-88fa-ae4fa96b794b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:17.069595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-346ed021-707f-4b56-88fa-ae4fa96b794b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:17.313095 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-346ed021-707f-4b56-88fa-ae4fa96b794b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:17.336483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-346ed021-707f-4b56-88fa-ae4fa96b794b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1272 microversion: 2.1 time: 0.314026 Oct 27 14:08:17.337706 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 19/36] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:17 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:18.021190 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-5a6fca74-12cf-41b7-ab14-d9533c9a1af6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:18.022247 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-5a6fca74-12cf-41b7-ab14-d9533c9a1af6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:18.046557 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5a6fca74-12cf-41b7-ab14-d9533c9a1af6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:18.047723 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5a6fca74-12cf-41b7-ab14-d9533c9a1af6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:18.048831 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5a6fca74-12cf-41b7-ab14-d9533c9a1af6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:18.049436 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5a6fca74-12cf-41b7-ab14-d9533c9a1af6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:18.359503 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ec698016-0620-4006-8c94-407dcd39e665 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:18.360579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ec698016-0620-4006-8c94-407dcd39e665 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:18.379996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ec698016-0620-4006-8c94-407dcd39e665 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:18.381154 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ec698016-0620-4006-8c94-407dcd39e665 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:18.383260 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ec698016-0620-4006-8c94-407dcd39e665 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:18.384489 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ec698016-0620-4006-8c94-407dcd39e665 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:19.237136 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-5a6fca74-12cf-41b7-ab14-d9533c9a1af6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:19.260321 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-5a6fca74-12cf-41b7-ab14-d9533c9a1af6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1269 microversion: 2.1 time: 1.255727 Oct 27 14:08:19.262137 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 18/37] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:18 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1269 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:19.623218 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ec698016-0620-4006-8c94-407dcd39e665 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:19.640546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ec698016-0620-4006-8c94-407dcd39e665 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 1.286727 Oct 27 14:08:19.641152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 20/38] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:18 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:20.299687 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-825969ac-51ee-4a80-a89e-b924f90f5104 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:20.304449 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-825969ac-51ee-4a80-a89e-b924f90f5104 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:20.360318 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-825969ac-51ee-4a80-a89e-b924f90f5104 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:20.365659 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-825969ac-51ee-4a80-a89e-b924f90f5104 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:20.369448 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-825969ac-51ee-4a80-a89e-b924f90f5104 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:20.372745 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-825969ac-51ee-4a80-a89e-b924f90f5104 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:20.660952 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b0214bf6-060d-473a-983b-3757e1517d3e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:20.661813 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b0214bf6-060d-473a-983b-3757e1517d3e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:20.672136 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b0214bf6-060d-473a-983b-3757e1517d3e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:20.672586 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b0214bf6-060d-473a-983b-3757e1517d3e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:20.682061 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b0214bf6-060d-473a-983b-3757e1517d3e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:20.684697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b0214bf6-060d-473a-983b-3757e1517d3e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:20.967923 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-825969ac-51ee-4a80-a89e-b924f90f5104 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:20.985720 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-825969ac-51ee-4a80-a89e-b924f90f5104 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1275 microversion: 2.1 time: 0.703729 Oct 27 14:08:20.986420 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 19/39] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:20 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1275 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:22.007282 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4c09ed23-e111-4e70-bba2-0e8be5eb0ac3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:22.008231 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4c09ed23-e111-4e70-bba2-0e8be5eb0ac3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:22.032455 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4c09ed23-e111-4e70-bba2-0e8be5eb0ac3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:22.035063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b0214bf6-060d-473a-983b-3757e1517d3e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:22.035656 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4c09ed23-e111-4e70-bba2-0e8be5eb0ac3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:22.037073 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4c09ed23-e111-4e70-bba2-0e8be5eb0ac3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:22.044555 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4c09ed23-e111-4e70-bba2-0e8be5eb0ac3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:22.048583 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b0214bf6-060d-473a-983b-3757e1517d3e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 1.391175 Oct 27 14:08:22.050333 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 21/40] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:20 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:22.669093 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4c09ed23-e111-4e70-bba2-0e8be5eb0ac3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:22.682898 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4c09ed23-e111-4e70-bba2-0e8be5eb0ac3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1275 microversion: 2.1 time: 0.676997 Oct 27 14:08:22.684241 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 20/41] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:22 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1275 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:23.081753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7e03463d-d700-4718-8e46-db3e003e5319 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:23.083531 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7e03463d-d700-4718-8e46-db3e003e5319 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:23.117624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e03463d-d700-4718-8e46-db3e003e5319 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:23.120378 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e03463d-d700-4718-8e46-db3e003e5319 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:23.127700 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e03463d-d700-4718-8e46-db3e003e5319 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:23.128952 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e03463d-d700-4718-8e46-db3e003e5319 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:23.702174 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-55cd21b6-72f8-4b9c-bb25-cca14d58a42b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:23.703012 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-55cd21b6-72f8-4b9c-bb25-cca14d58a42b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:23.727385 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-55cd21b6-72f8-4b9c-bb25-cca14d58a42b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:23.727943 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-55cd21b6-72f8-4b9c-bb25-cca14d58a42b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:23.729996 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-55cd21b6-72f8-4b9c-bb25-cca14d58a42b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:23.734058 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-55cd21b6-72f8-4b9c-bb25-cca14d58a42b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:23.940309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7e03463d-d700-4718-8e46-db3e003e5319 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:23.966510 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7e03463d-d700-4718-8e46-db3e003e5319 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.891949 Oct 27 14:08:23.969009 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-55cd21b6-72f8-4b9c-bb25-cca14d58a42b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:23.978183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 22/42] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:23 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:23.980999 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-55cd21b6-72f8-4b9c-bb25-cca14d58a42b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1275 microversion: 2.1 time: 0.282989 Oct 27 14:08:23.989758 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 21/43] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:23 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1275 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:24.999544 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-07a3aa0d-706d-4aaa-a2a2-701f3952cf8a tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:25.001026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-07a3aa0d-706d-4aaa-a2a2-701f3952cf8a tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:25.008671 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1fe53445-5632-4da1-a690-b960e92cc3ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:25.009945 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1fe53445-5632-4da1-a690-b960e92cc3ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:25.026158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07a3aa0d-706d-4aaa-a2a2-701f3952cf8a tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:25.028877 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1fe53445-5632-4da1-a690-b960e92cc3ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:25.029690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07a3aa0d-706d-4aaa-a2a2-701f3952cf8a tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:25.030875 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1fe53445-5632-4da1-a690-b960e92cc3ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:25.032799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07a3aa0d-706d-4aaa-a2a2-701f3952cf8a tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:25.033885 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1fe53445-5632-4da1-a690-b960e92cc3ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:25.037334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07a3aa0d-706d-4aaa-a2a2-701f3952cf8a tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:25.039217 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1fe53445-5632-4da1-a690-b960e92cc3ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:25.519220 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1fe53445-5632-4da1-a690-b960e92cc3ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:25.537309 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1fe53445-5632-4da1-a690-b960e92cc3ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1275 microversion: 2.1 time: 0.529475 Oct 27 14:08:25.540414 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 22/44] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:25 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1275 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:25.886259 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-350bf84a-3727-4cb6-a8d4-d70ff5bb4116 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'create', calling method: .version_select at 0x7f4570b1e670>, body: {"keypair": {"name": "tempest-keypair-226428762"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:25.946123 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-350bf84a-3727-4cb6-a8d4-d70ff5bb4116 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for project c84e18e41f634c02ac87674f5f6da28d. Resources: {'key_pairs'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:08:25.953822 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-350bf84a-3727-4cb6-a8d4-d70ff5bb4116 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for user d777531f3785498189495db0e1932c26 and project c84e18e41f634c02ac87674f5f6da28d. Resources: {'key_pairs'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:08:26.393221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-07a3aa0d-706d-4aaa-a2a2-701f3952cf8a tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:26.404506 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-07a3aa0d-706d-4aaa-a2a2-701f3952cf8a tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 1.410908 Oct 27 14:08:26.408092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 23/45] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:24 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:26.567932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f98543a3-2371-4d60-884a-5cb5dc46ce47 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:26.569074 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f98543a3-2371-4d60-884a-5cb5dc46ce47 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:26.581173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f98543a3-2371-4d60-884a-5cb5dc46ce47 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:26.587936 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f98543a3-2371-4d60-884a-5cb5dc46ce47 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:26.592162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f98543a3-2371-4d60-884a-5cb5dc46ce47 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:26.613405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f98543a3-2371-4d60-884a-5cb5dc46ce47 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:27.290110 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-350bf84a-3727-4cb6-a8d4-d70ff5bb4116 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for project c84e18e41f634c02ac87674f5f6da28d. Resources: {'key_pairs'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:08:27.315539 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-350bf84a-3727-4cb6-a8d4-d70ff5bb4116 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for user d777531f3785498189495db0e1932c26 and project c84e18e41f634c02ac87674f5f6da28d. Resources: {'key_pairs'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:08:27.362541 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-350bf84a-3727-4cb6-a8d4-d70ff5bb4116 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.789229 Oct 27 14:08:27.368672 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 23/46] 10.222.0.85 () {62 vars in 1198 bytes} [Wed Oct 27 14:08:25 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1797 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Oct 27 14:08:27.969553 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-4414c8d5-caba-456c-b301-e2b37ad5cfd7 req-66168e6c-2a77-48f4-8ecb-128d132a690c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f33dcc-4df0-4c90-b5b3-6fab1b81faab", "tag": "99d7fdc5-8676-4e9b-9ec5-5c8018f479cf"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:27.972106 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:27.972106 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:08:28.007980 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-4414c8d5-caba-456c-b301-e2b37ad5cfd7 req-66168e6c-2a77-48f4-8ecb-128d132a690c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:28.008440 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-4414c8d5-caba-456c-b301-e2b37ad5cfd7 req-66168e6c-2a77-48f4-8ecb-128d132a690c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:28.086374 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-4414c8d5-caba-456c-b301-e2b37ad5cfd7 req-66168e6c-2a77-48f4-8ecb-128d132a690c service nova] Creating event network-changed:99d7fdc5-8676-4e9b-9ec5-5c8018f479cf for instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab on hv-cinder-81566 Oct 27 14:08:28.086919 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-4414c8d5-caba-456c-b301-e2b37ad5cfd7 req-66168e6c-2a77-48f4-8ecb-128d132a690c service nova] Acquired lock "compute-rpcapi-router" {{(pid=115932) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 27 14:08:28.104615 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4683ab9d-e2ec-4fda-b6c5-37e79f37b305 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:28.105081 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4683ab9d-e2ec-4fda-b6c5-37e79f37b305 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:28.105933 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4683ab9d-e2ec-4fda-b6c5-37e79f37b305 None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:28.106376 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4683ab9d-e2ec-4fda-b6c5-37e79f37b305 None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:28.150424 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.compute.rpcapi [None req-4683ab9d-e2ec-4fda-b6c5-37e79f37b305 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 27 14:08:28.154472 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4683ab9d-e2ec-4fda-b6c5-37e79f37b305 None None] Releasing lock "compute-rpcapi-router" {{(pid=115932) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 27 14:08:28.218499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f98543a3-2371-4d60-884a-5cb5dc46ce47 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:28.238104 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f98543a3-2371-4d60-884a-5cb5dc46ce47 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 1.685273 Oct 27 14:08:28.241583 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4683ab9d-e2ec-4fda-b6c5-37e79f37b305 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.868323 Oct 27 14:08:28.242946 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 24/47] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:08:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:28.257952 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-92dc21e7-eb06-4343-9351-7c08e396ab6e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:28.259677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 24/48] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:26 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:28.264128 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-92dc21e7-eb06-4343-9351-7c08e396ab6e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:28.290733 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-92dc21e7-eb06-4343-9351-7c08e396ab6e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:28.295949 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-92dc21e7-eb06-4343-9351-7c08e396ab6e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:28.297043 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-92dc21e7-eb06-4343-9351-7c08e396ab6e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:28.297507 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-92dc21e7-eb06-4343-9351-7c08e396ab6e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:29.269507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-53f3fff3-fe0d-4052-b933-64909e0908d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:29.270517 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-53f3fff3-fe0d-4052-b933-64909e0908d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:29.288708 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53f3fff3-fe0d-4052-b933-64909e0908d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:29.291152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53f3fff3-fe0d-4052-b933-64909e0908d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:29.297232 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53f3fff3-fe0d-4052-b933-64909e0908d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:29.301641 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53f3fff3-fe0d-4052-b933-64909e0908d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:29.891156 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-92dc21e7-eb06-4343-9351-7c08e396ab6e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:29.899658 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-92dc21e7-eb06-4343-9351-7c08e396ab6e tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 1.653694 Oct 27 14:08:29.903500 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 25/49] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:28 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:30.363802 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d5701cf0-399f-4680-81be-f8644458817b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'create', calling method: .version_select at 0x7f4570a4e3a0>, body: {"keypair": {"name": "tempest-keypair-1890036324"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:30.429511 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-d5701cf0-399f-4680-81be-f8644458817b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'key_pairs'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:08:30.443975 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-d5701cf0-399f-4680-81be-f8644458817b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for user ff5c722cc57744d886ba552ce2571745 and project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'key_pairs'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:08:30.807640 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-53f3fff3-fe0d-4052-b933-64909e0908d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:30.821027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-53f3fff3-fe0d-4052-b933-64909e0908d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 1.558097 Oct 27 14:08:30.822471 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 25/50] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:29 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:30.928173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-24d63a92-f57f-4358-bfde-9f123f491127 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:30.929371 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-24d63a92-f57f-4358-bfde-9f123f491127 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:30.939164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-24d63a92-f57f-4358-bfde-9f123f491127 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:30.941753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-24d63a92-f57f-4358-bfde-9f123f491127 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:30.944598 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-24d63a92-f57f-4358-bfde-9f123f491127 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:30.948074 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-24d63a92-f57f-4358-bfde-9f123f491127 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:30.968070 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-d5701cf0-399f-4680-81be-f8644458817b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'key_pairs'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:08:30.984515 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-d5701cf0-399f-4680-81be-f8644458817b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for user ff5c722cc57744d886ba552ce2571745 and project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'key_pairs'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:08:31.025826 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d5701cf0-399f-4680-81be-f8644458817b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.120843 Oct 27 14:08:31.026592 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 26/51] 10.222.0.85 () {60 vars in 1157 bytes} [Wed Oct 27 14:08:29 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:31.603719 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-24d63a92-f57f-4358-bfde-9f123f491127 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:31.614511 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-24d63a92-f57f-4358-bfde-9f123f491127 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.688644 Oct 27 14:08:31.617018 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 26/52] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:30 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:31.846016 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d2c37a44-e4bd-4e38-bdfb-12905cde40af tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:31.847476 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d2c37a44-e4bd-4e38-bdfb-12905cde40af tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:31.867312 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d2c37a44-e4bd-4e38-bdfb-12905cde40af tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:31.868443 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d2c37a44-e4bd-4e38-bdfb-12905cde40af tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:31.869547 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d2c37a44-e4bd-4e38-bdfb-12905cde40af tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:31.872997 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d2c37a44-e4bd-4e38-bdfb-12905cde40af tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:32.346500 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-d2c37a44-e4bd-4e38-bdfb-12905cde40af tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:32.357309 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d2c37a44-e4bd-4e38-bdfb-12905cde40af tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.520369 Oct 27 14:08:32.369407 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 27/53] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:31 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:32.440920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-06f2834a-ef57-479c-82ed-d4fc6ea53691 req-5f1a3faa-d49b-4bbe-928d-99810d6f525a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e098f1a-7a67-49aa-8612-ecf546da5a62", "tag": "60d5d634-d73e-43e2-9077-dd41c390011b"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:32.474401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:32.474401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:08:32.513441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-06f2834a-ef57-479c-82ed-d4fc6ea53691 req-5f1a3faa-d49b-4bbe-928d-99810d6f525a service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:32.520221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-06f2834a-ef57-479c-82ed-d4fc6ea53691 req-5f1a3faa-d49b-4bbe-928d-99810d6f525a service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:32.592775 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-06f2834a-ef57-479c-82ed-d4fc6ea53691 req-5f1a3faa-d49b-4bbe-928d-99810d6f525a service nova] Creating event network-changed:60d5d634-d73e-43e2-9077-dd41c390011b for instance 1e098f1a-7a67-49aa-8612-ecf546da5a62 on hv-cinder-81566 Oct 27 14:08:32.595703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-06f2834a-ef57-479c-82ed-d4fc6ea53691 req-5f1a3faa-d49b-4bbe-928d-99810d6f525a service nova] Acquired lock "compute-rpcapi-router" {{(pid=115931) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 27 14:08:32.596898 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da4fa650-7a3f-4ca3-b424-8038681fca21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:32.611037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da4fa650-7a3f-4ca3-b424-8038681fca21 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:32.612155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da4fa650-7a3f-4ca3-b424-8038681fca21 None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:32.612602 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da4fa650-7a3f-4ca3-b424-8038681fca21 None None] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:32.652360 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.compute.rpcapi [None req-da4fa650-7a3f-4ca3-b424-8038681fca21 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 27 14:08:32.655843 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-850f5aec-2e80-4266-8db0-76c863505494 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:32.656961 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-850f5aec-2e80-4266-8db0-76c863505494 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:32.659543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da4fa650-7a3f-4ca3-b424-8038681fca21 None None] Releasing lock "compute-rpcapi-router" {{(pid=115931) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 27 14:08:32.671177 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-850f5aec-2e80-4266-8db0-76c863505494 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:32.672207 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-850f5aec-2e80-4266-8db0-76c863505494 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:32.673599 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-850f5aec-2e80-4266-8db0-76c863505494 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:32.674396 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-850f5aec-2e80-4266-8db0-76c863505494 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:32.750318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-da4fa650-7a3f-4ca3-b424-8038681fca21 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.322796 Oct 27 14:08:32.750902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 27/54] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:08:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:33.157269 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-850f5aec-2e80-4266-8db0-76c863505494 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:33.175939 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-850f5aec-2e80-4266-8db0-76c863505494 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.537797 Oct 27 14:08:33.179582 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 28/55] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:32 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:33.381916 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-767a1f82-f3bd-4ff0-ae67-809a12a58f3b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:33.391558 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-767a1f82-f3bd-4ff0-ae67-809a12a58f3b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:33.410422 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-767a1f82-f3bd-4ff0-ae67-809a12a58f3b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:33.411258 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-767a1f82-f3bd-4ff0-ae67-809a12a58f3b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:33.412796 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-767a1f82-f3bd-4ff0-ae67-809a12a58f3b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:33.414437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-767a1f82-f3bd-4ff0-ae67-809a12a58f3b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:34.230391 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-622573488", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e326cd63-ddc3-4370-9359-292ac983dba9"}]}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:34.267682 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-767a1f82-f3bd-4ff0-ae67-809a12a58f3b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:34.278633 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-767a1f82-f3bd-4ff0-ae67-809a12a58f3b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.904565 Oct 27 14:08:34.283519 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 28/56] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:33 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:34.297221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5b448154-6034-4efd-9c24-8cac03e35b58 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:34.297907 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5b448154-6034-4efd-9c24-8cac03e35b58 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:34.311031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b448154-6034-4efd-9c24-8cac03e35b58 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:34.311892 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b448154-6034-4efd-9c24-8cac03e35b58 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:34.314004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b448154-6034-4efd-9c24-8cac03e35b58 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:34.315767 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b448154-6034-4efd-9c24-8cac03e35b58 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:34.340077 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.network.neutron [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] validate_networks() for [('e326cd63-ddc3-4370-9359-292ac983dba9', None, None, None, None, None)] {{(pid=115932) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:08:34.972123 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5b448154-6034-4efd-9c24-8cac03e35b58 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:34.988651 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5b448154-6034-4efd-9c24-8cac03e35b58 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.702182 Oct 27 14:08:34.992226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 29/57] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:34 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:35.302161 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7529290b-3d5e-4177-abb0-bbaf5fd4b69e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:35.302798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7529290b-3d5e-4177-abb0-bbaf5fd4b69e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:35.317042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7529290b-3d5e-4177-abb0-bbaf5fd4b69e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:35.318715 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7529290b-3d5e-4177-abb0-bbaf5fd4b69e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:35.322468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7529290b-3d5e-4177-abb0-bbaf5fd4b69e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:35.326246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7529290b-3d5e-4177-abb0-bbaf5fd4b69e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:36.391592 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7529290b-3d5e-4177-abb0-bbaf5fd4b69e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:36.413803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7529290b-3d5e-4177-abb0-bbaf5fd4b69e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 1.114337 Oct 27 14:08:36.416502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 30/58] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:35 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:36.431640 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-69f75f7e-98b8-43c3-b638-e68aca3f57a3 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:36.438504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-69f75f7e-98b8-43c3-b638-e68aca3f57a3 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:36.464766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69f75f7e-98b8-43c3-b638-e68aca3f57a3 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:36.466189 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69f75f7e-98b8-43c3-b638-e68aca3f57a3 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:36.468228 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69f75f7e-98b8-43c3-b638-e68aca3f57a3 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:36.469945 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69f75f7e-98b8-43c3-b638-e68aca3f57a3 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:36.618544 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Flavor limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:08:36.620060 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Image limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:08:36.620694 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Flavor pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:08:36.621227 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Image pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:08:36.622157 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:08:36.649938 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:36.651368 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:36.653109 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:36.653702 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:36.687346 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Getting quotas for project d165e7dc8a9245e9a982ffcabc980675. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:08:36.703074 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Getting quotas for user 9da1f8decfb14aaaa69e6592ec5630a2 and project d165e7dc8a9245e9a982ffcabc980675. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:08:36.731640 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Going to run 1 instances... {{(pid=115932) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:08:36.735041 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:08:36.834589 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-bb3468bc-04d5-4248-9536-4c92b58077cb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.862669 Oct 27 14:08:36.844832 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 29/59] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:08:33 2021] POST /compute/v2.1/servers => generated 383 bytes in 2876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 14:08:36.856302 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1a6a45b7-2cbe-4a23-b86d-7dc628fada3d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:36.857682 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1a6a45b7-2cbe-4a23-b86d-7dc628fada3d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:37.036271 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-69f75f7e-98b8-43c3-b638-e68aca3f57a3 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:37.054611 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-69f75f7e-98b8-43c3-b638-e68aca3f57a3 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.635856 Oct 27 14:08:37.057037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 31/60] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:36 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:37.089222 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1068182220", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11f7b24e-a72d-42e4-91c7-58ce8c0bc8de"}], "security_groups": [{"name": "tempest-securitygroup--1127487707"}], "key_name": "tempest-keypair-226428762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:37.192145 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1a6a45b7-2cbe-4a23-b86d-7dc628fada3d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:37.207620 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1a6a45b7-2cbe-4a23-b86d-7dc628fada3d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1221 microversion: 2.1 time: 0.361374 Oct 27 14:08:37.212743 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 30/61] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:36 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1221 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:37.323810 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-744420026", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e326cd63-ddc3-4370-9359-292ac983dba9"}]}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:37.419480 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.network.neutron [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] validate_networks() for [('e326cd63-ddc3-4370-9359-292ac983dba9', None, None, None, None, None)] {{(pid=115932) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:08:37.757599 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] validate_networks() for [('11f7b24e-a72d-42e4-91c7-58ce8c0bc8de', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:08:38.662533 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:08:38.664022 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:08:38.664912 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:08:38.667628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:08:38.668446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:08:38.686412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:38.687262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:38.688322 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:38.688961 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:38.707742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for project c84e18e41f634c02ac87674f5f6da28d. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:08:38.714396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for user d777531f3785498189495db0e1932c26 and project c84e18e41f634c02ac87674f5f6da28d. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:08:38.733962 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:08:38.741515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:08:38.799313 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f093fc21-536c-4efe-868d-5f150d32a8ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.734917 Oct 27 14:08:38.800289 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 32/62] 10.222.0.85 () {62 vars in 1187 bytes} [Wed Oct 27 14:08:37 2021] POST /compute/v2.1/servers => generated 402 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 14:08:38.805381 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3565c5b2-0778-40e5-ad1a-8f69700dcbc6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:38.806248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3565c5b2-0778-40e5-ad1a-8f69700dcbc6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:38.812484 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3565c5b2-0778-40e5-ad1a-8f69700dcbc6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:38.813245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3565c5b2-0778-40e5-ad1a-8f69700dcbc6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:38.814246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3565c5b2-0778-40e5-ad1a-8f69700dcbc6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:38.814877 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3565c5b2-0778-40e5-ad1a-8f69700dcbc6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:39.361032 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3565c5b2-0778-40e5-ad1a-8f69700dcbc6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:39.370974 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3565c5b2-0778-40e5-ad1a-8f69700dcbc6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.569479 Oct 27 14:08:39.371717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 33/63] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:38 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:39.392250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2deaa86c-9b22-4c5a-904e-f4ad0c2de8f0 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:39.393327 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2deaa86c-9b22-4c5a-904e-f4ad0c2de8f0 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:39.397509 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Flavor limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:08:39.398103 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Image limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:08:39.398103 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Flavor pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:08:39.398627 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Image pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:08:39.399046 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:08:39.403452 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2deaa86c-9b22-4c5a-904e-f4ad0c2de8f0 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:39.404232 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2deaa86c-9b22-4c5a-904e-f4ad0c2de8f0 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:39.405268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2deaa86c-9b22-4c5a-904e-f4ad0c2de8f0 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:39.405908 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2deaa86c-9b22-4c5a-904e-f4ad0c2de8f0 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:39.421112 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:39.421579 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:39.422408 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:39.422874 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:39.451430 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Getting quotas for project d165e7dc8a9245e9a982ffcabc980675. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:08:39.455765 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Getting quotas for user 9da1f8decfb14aaaa69e6592ec5630a2 and project d165e7dc8a9245e9a982ffcabc980675. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:08:39.478808 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Going to run 1 instances... {{(pid=115932) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:08:39.481784 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:08:39.547591 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-61039dfe-cd04-43ad-ac52-8de28f81328e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.236621 Oct 27 14:08:39.548780 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 31/64] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:08:37 2021] POST /compute/v2.1/servers => generated 383 bytes in 2238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:08:39.554083 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ec33291b-9bfb-4b37-88c7-be5a078a6e5b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:39.555110 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ec33291b-9bfb-4b37-88c7-be5a078a6e5b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:39.562166 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec33291b-9bfb-4b37-88c7-be5a078a6e5b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:39.562792 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec33291b-9bfb-4b37-88c7-be5a078a6e5b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:39.563776 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec33291b-9bfb-4b37-88c7-be5a078a6e5b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:39.564384 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec33291b-9bfb-4b37-88c7-be5a078a6e5b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:39.635409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2deaa86c-9b22-4c5a-904e-f4ad0c2de8f0 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:39.645783 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2deaa86c-9b22-4c5a-904e-f4ad0c2de8f0 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.265135 Oct 27 14:08:39.649032 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 34/65] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:39 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:39.657342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1724081908", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57ab640a-d6ea-4ec6-b7cb-d71aba31dbee"}], "security_groups": [{"name": "tempest-securitygroup--1529087691"}], "key_name": "tempest-keypair-1890036324", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:39.680196 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ec33291b-9bfb-4b37-88c7-be5a078a6e5b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:39.690915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ec33291b-9bfb-4b37-88c7-be5a078a6e5b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:39.692825 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ec33291b-9bfb-4b37-88c7-be5a078a6e5b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:39.695473 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ec33291b-9bfb-4b37-88c7-be5a078a6e5b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1285 microversion: 2.20 time: 0.144289 Oct 27 14:08:39.696347 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 32/66] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:39 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:08:39.719450 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-baa2aa34-c8b1-4ad8-aa6d-1949d4dfb4b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:39.720276 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-baa2aa34-c8b1-4ad8-aa6d-1949d4dfb4b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:39.844850 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-baa2aa34-c8b1-4ad8-aa6d-1949d4dfb4b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:39.854534 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-baa2aa34-c8b1-4ad8-aa6d-1949d4dfb4b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1221 microversion: 2.1 time: 0.156771 Oct 27 14:08:39.857875 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 33/67] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:39 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:39.887018 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] validate_networks() for [('57ab640a-d6ea-4ec6-b7cb-d71aba31dbee', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:08:40.389997 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-90f2340b-77d4-4d0d-a0bc-3522b1597cce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:40.392330 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-90f2340b-77d4-4d0d-a0bc-3522b1597cce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:40.399468 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-90f2340b-77d4-4d0d-a0bc-3522b1597cce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:40.401263 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-90f2340b-77d4-4d0d-a0bc-3522b1597cce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:40.402168 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-90f2340b-77d4-4d0d-a0bc-3522b1597cce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:40.402831 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-90f2340b-77d4-4d0d-a0bc-3522b1597cce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:40.493833 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:08:40.494293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:08:40.495005 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:08:40.495391 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:08:40.496409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:08:40.512497 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:40.513552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:40.514550 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:40.515395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:40.549165 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:08:40.555430 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for user ff5c722cc57744d886ba552ce2571745 and project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:08:40.567405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:08:40.570172 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:08:40.668116 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5f146d43-0e4d-4f24-a9a6-d76b6a60e609 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.017736 Oct 27 14:08:40.669696 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 35/68] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:08:39 2021] POST /compute/v2.1/servers => generated 402 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:08:40.675447 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-524421a2-8d33-4cb8-9b1d-510f85baef56 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:40.676485 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-524421a2-8d33-4cb8-9b1d-510f85baef56 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:40.679066 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-90f2340b-77d4-4d0d-a0bc-3522b1597cce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:40.685017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-524421a2-8d33-4cb8-9b1d-510f85baef56 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:40.686283 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-524421a2-8d33-4cb8-9b1d-510f85baef56 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:40.687401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-524421a2-8d33-4cb8-9b1d-510f85baef56 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:40.688156 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-524421a2-8d33-4cb8-9b1d-510f85baef56 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:40.694375 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-90f2340b-77d4-4d0d-a0bc-3522b1597cce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.308010 Oct 27 14:08:40.696754 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 34/69] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:40 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:40.711781 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-65e431b2-a4d0-49b4-b534-87665d1f8ffb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:40.712403 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-65e431b2-a4d0-49b4-b534-87665d1f8ffb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:40.852144 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-65e431b2-a4d0-49b4-b534-87665d1f8ffb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:40.903476 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-65e431b2-a4d0-49b4-b534-87665d1f8ffb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1238 microversion: 2.1 time: 0.204705 Oct 27 14:08:40.923788 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 35/70] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:40 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1238 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:40.952336 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-258dae3c-dca1-4c9c-a22d-a14b0589530f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:40.952961 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-258dae3c-dca1-4c9c-a22d-a14b0589530f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:40.982986 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-258dae3c-dca1-4c9c-a22d-a14b0589530f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:40.983727 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-258dae3c-dca1-4c9c-a22d-a14b0589530f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:40.986304 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-258dae3c-dca1-4c9c-a22d-a14b0589530f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:40.987442 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-258dae3c-dca1-4c9c-a22d-a14b0589530f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:41.109713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-524421a2-8d33-4cb8-9b1d-510f85baef56 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:41.121303 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-524421a2-8d33-4cb8-9b1d-510f85baef56 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.450050 Oct 27 14:08:41.129975 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 36/71] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:40 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:41.143291 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2bce5836-e59c-42de-8faa-8a72f4ec423d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:41.151911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2bce5836-e59c-42de-8faa-8a72f4ec423d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:41.163457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2bce5836-e59c-42de-8faa-8a72f4ec423d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:41.170314 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-258dae3c-dca1-4c9c-a22d-a14b0589530f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:41.183267 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2bce5836-e59c-42de-8faa-8a72f4ec423d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:41.185141 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2bce5836-e59c-42de-8faa-8a72f4ec423d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:41.185608 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2bce5836-e59c-42de-8faa-8a72f4ec423d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:41.187564 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-258dae3c-dca1-4c9c-a22d-a14b0589530f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:41.191394 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-258dae3c-dca1-4c9c-a22d-a14b0589530f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:41.194789 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-258dae3c-dca1-4c9c-a22d-a14b0589530f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1285 microversion: 2.20 time: 0.269123 Oct 27 14:08:41.210938 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 36/72] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:40 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1285 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:08:41.326145 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2bce5836-e59c-42de-8faa-8a72f4ec423d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:41.334296 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2bce5836-e59c-42de-8faa-8a72f4ec423d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1273 microversion: 2.1 time: 0.202513 Oct 27 14:08:41.337274 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 37/73] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:41 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:41.714552 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1c3f969a-a8b1-44d4-8f96-e1d822f0ad42 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:41.716336 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1c3f969a-a8b1-44d4-8f96-e1d822f0ad42 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:41.734406 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c3f969a-a8b1-44d4-8f96-e1d822f0ad42 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:41.735872 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c3f969a-a8b1-44d4-8f96-e1d822f0ad42 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:41.739491 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c3f969a-a8b1-44d4-8f96-e1d822f0ad42 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:41.741271 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c3f969a-a8b1-44d4-8f96-e1d822f0ad42 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:41.927442 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-244d44d9-f625-45bf-89f5-d162e21df7e2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:41.928056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-244d44d9-f625-45bf-89f5-d162e21df7e2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:41.937882 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-244d44d9-f625-45bf-89f5-d162e21df7e2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:41.938334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-244d44d9-f625-45bf-89f5-d162e21df7e2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:41.939318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-244d44d9-f625-45bf-89f5-d162e21df7e2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:41.939649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-244d44d9-f625-45bf-89f5-d162e21df7e2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:42.023723 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1c3f969a-a8b1-44d4-8f96-e1d822f0ad42 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:42.049404 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1c3f969a-a8b1-44d4-8f96-e1d822f0ad42 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.340520 Oct 27 14:08:42.050045 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 37/74] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:41 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:42.069578 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-244d44d9-f625-45bf-89f5-d162e21df7e2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:42.078518 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-244d44d9-f625-45bf-89f5-d162e21df7e2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1242 microversion: 2.1 time: 0.154817 Oct 27 14:08:42.079105 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 38/75] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:41 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1242 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:42.145813 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f837efec-9ecb-44c3-a153-32d44047a42b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:42.146615 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f837efec-9ecb-44c3-a153-32d44047a42b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:42.154038 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f837efec-9ecb-44c3-a153-32d44047a42b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:42.154553 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f837efec-9ecb-44c3-a153-32d44047a42b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:42.155591 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f837efec-9ecb-44c3-a153-32d44047a42b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:42.156332 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f837efec-9ecb-44c3-a153-32d44047a42b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:42.228921 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a5e546bc-78cd-4d38-a406-f3fa0cc76ed8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:42.229676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a5e546bc-78cd-4d38-a406-f3fa0cc76ed8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:42.239458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a5e546bc-78cd-4d38-a406-f3fa0cc76ed8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:42.245468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a5e546bc-78cd-4d38-a406-f3fa0cc76ed8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:42.248764 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a5e546bc-78cd-4d38-a406-f3fa0cc76ed8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:42.249742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a5e546bc-78cd-4d38-a406-f3fa0cc76ed8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:42.460135 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a5e546bc-78cd-4d38-a406-f3fa0cc76ed8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:42.479024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a5e546bc-78cd-4d38-a406-f3fa0cc76ed8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:42.480858 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a5e546bc-78cd-4d38-a406-f3fa0cc76ed8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:42.488488 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a5e546bc-78cd-4d38-a406-f3fa0cc76ed8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1277 microversion: 2.20 time: 0.263451 Oct 27 14:08:42.489438 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 39/76] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:42 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:08:42.503499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-792a730b-f0f4-446a-abc9-7d9bcc0028f0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:42.504437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-792a730b-f0f4-446a-abc9-7d9bcc0028f0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:42.524526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-792a730b-f0f4-446a-abc9-7d9bcc0028f0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:42.525361 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-792a730b-f0f4-446a-abc9-7d9bcc0028f0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:42.528184 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-792a730b-f0f4-446a-abc9-7d9bcc0028f0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:42.529905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-792a730b-f0f4-446a-abc9-7d9bcc0028f0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:42.632439 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-f837efec-9ecb-44c3-a153-32d44047a42b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:42.663851 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f837efec-9ecb-44c3-a153-32d44047a42b tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.519889 Oct 27 14:08:42.664499 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 38/77] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:42 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:42.743734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-792a730b-f0f4-446a-abc9-7d9bcc0028f0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:42.757020 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-792a730b-f0f4-446a-abc9-7d9bcc0028f0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1279 microversion: 2.1 time: 0.266057 Oct 27 14:08:42.760421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 40/78] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:42 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1279 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:43.067492 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2da3e160-b368-4f65-b2c7-a23e348dc2e4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:43.068230 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2da3e160-b368-4f65-b2c7-a23e348dc2e4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:43.091958 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2da3e160-b368-4f65-b2c7-a23e348dc2e4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:43.096490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-047f83ca-c628-4d2e-92e5-912f755c82ec tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:43.097105 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-047f83ca-c628-4d2e-92e5-912f755c82ec tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:43.098081 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2da3e160-b368-4f65-b2c7-a23e348dc2e4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:43.103589 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2da3e160-b368-4f65-b2c7-a23e348dc2e4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:43.105759 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2da3e160-b368-4f65-b2c7-a23e348dc2e4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:43.121551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-047f83ca-c628-4d2e-92e5-912f755c82ec tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:43.124042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-047f83ca-c628-4d2e-92e5-912f755c82ec tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:43.128281 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-047f83ca-c628-4d2e-92e5-912f755c82ec tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:43.135880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-047f83ca-c628-4d2e-92e5-912f755c82ec tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:43.356602 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-047f83ca-c628-4d2e-92e5-912f755c82ec tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:43.365009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-047f83ca-c628-4d2e-92e5-912f755c82ec tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1290 microversion: 2.1 time: 0.272939 Oct 27 14:08:43.370345 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 41/79] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:43 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1290 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:43.502655 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2da3e160-b368-4f65-b2c7-a23e348dc2e4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:43.509553 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f2216fdb-199c-430a-9db0-92815dfb85b8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:43.510173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f2216fdb-199c-430a-9db0-92815dfb85b8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:43.521340 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2da3e160-b368-4f65-b2c7-a23e348dc2e4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.455605 Oct 27 14:08:43.525165 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 39/80] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:43 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:43.525341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2216fdb-199c-430a-9db0-92815dfb85b8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:43.525759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2216fdb-199c-430a-9db0-92815dfb85b8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:43.526583 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2216fdb-199c-430a-9db0-92815dfb85b8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:43.527024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2216fdb-199c-430a-9db0-92815dfb85b8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:43.680940 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7512de88-5bf6-4d8c-b44f-b62015842e71 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:43.681550 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7512de88-5bf6-4d8c-b44f-b62015842e71 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:43.691182 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7512de88-5bf6-4d8c-b44f-b62015842e71 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:43.702984 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7512de88-5bf6-4d8c-b44f-b62015842e71 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:43.704008 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7512de88-5bf6-4d8c-b44f-b62015842e71 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:43.704455 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7512de88-5bf6-4d8c-b44f-b62015842e71 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:43.720088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f2216fdb-199c-430a-9db0-92815dfb85b8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:43.730080 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f2216fdb-199c-430a-9db0-92815dfb85b8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:43.745778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f2216fdb-199c-430a-9db0-92815dfb85b8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:43.749194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f2216fdb-199c-430a-9db0-92815dfb85b8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1339 microversion: 2.20 time: 0.242862 Oct 27 14:08:43.750333 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 42/81] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:43 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1339 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:08:43.788431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ade48748-87ee-4a4f-9807-14f5481b9838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:43.788934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ade48748-87ee-4a4f-9807-14f5481b9838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:43.803016 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ade48748-87ee-4a4f-9807-14f5481b9838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:43.805401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ade48748-87ee-4a4f-9807-14f5481b9838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:43.806652 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ade48748-87ee-4a4f-9807-14f5481b9838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:43.807269 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ade48748-87ee-4a4f-9807-14f5481b9838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:44.391363 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ade48748-87ee-4a4f-9807-14f5481b9838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:44.402534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ade48748-87ee-4a4f-9807-14f5481b9838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.617696 Oct 27 14:08:44.405637 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 43/82] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:43 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:44.453480 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-7512de88-5bf6-4d8c-b44f-b62015842e71 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:44.462227 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7512de88-5bf6-4d8c-b44f-b62015842e71 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.785557 Oct 27 14:08:44.465449 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 40/83] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:43 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:44.472819 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8c6ad74a-fced-4a57-8b90-413ef19479f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:44.473646 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-8c6ad74a-fced-4a57-8b90-413ef19479f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:44.495262 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8c6ad74a-fced-4a57-8b90-413ef19479f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:44.495723 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8c6ad74a-fced-4a57-8b90-413ef19479f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:44.496638 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8c6ad74a-fced-4a57-8b90-413ef19479f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:44.497066 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8c6ad74a-fced-4a57-8b90-413ef19479f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:44.599223 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-356d02ba-5413-4f40-949e-6e42011a7ea2 req-75f4f3b1-e84c-4ef4-807d-bfe997cd4ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f33dcc-4df0-4c90-b5b3-6fab1b81faab", "name": "network-vif-plugged", "status": "completed", "tag": "99d7fdc5-8676-4e9b-9ec5-5c8018f479cf"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:44.601801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:44.601801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:08:44.615496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-356d02ba-5413-4f40-949e-6e42011a7ea2 req-75f4f3b1-e84c-4ef4-807d-bfe997cd4ab5 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:44.619613 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-356d02ba-5413-4f40-949e-6e42011a7ea2 req-75f4f3b1-e84c-4ef4-807d-bfe997cd4ab5 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:44.653067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-356d02ba-5413-4f40-949e-6e42011a7ea2 req-75f4f3b1-e84c-4ef4-807d-bfe997cd4ab5 service nova] Creating event network-vif-plugged:99d7fdc5-8676-4e9b-9ec5-5c8018f479cf for instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab on hv-cinder-81566 Oct 27 14:08:44.670803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-356d02ba-5413-4f40-949e-6e42011a7ea2 req-75f4f3b1-e84c-4ef4-807d-bfe997cd4ab5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259919 Oct 27 14:08:44.672369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 44/84] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:08:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:44.686380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-406dfd73-9624-4eea-a375-7946147fd38c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:44.688885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-406dfd73-9624-4eea-a375-7946147fd38c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:44.706383 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-406dfd73-9624-4eea-a375-7946147fd38c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:44.707906 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-406dfd73-9624-4eea-a375-7946147fd38c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:44.708844 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-406dfd73-9624-4eea-a375-7946147fd38c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:44.710434 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-406dfd73-9624-4eea-a375-7946147fd38c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:44.832544 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-8c6ad74a-fced-4a57-8b90-413ef19479f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:44.849988 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-8c6ad74a-fced-4a57-8b90-413ef19479f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1296 microversion: 2.1 time: 0.383019 Oct 27 14:08:44.850685 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 41/85] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:44 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1296 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:44.855505 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-df1543c5-9122-4128-b9ab-cb9abd23e5e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:44.856103 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-df1543c5-9122-4128-b9ab-cb9abd23e5e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:44.880297 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-df1543c5-9122-4128-b9ab-cb9abd23e5e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:44.880887 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-df1543c5-9122-4128-b9ab-cb9abd23e5e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:44.882340 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-df1543c5-9122-4128-b9ab-cb9abd23e5e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:44.883070 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-df1543c5-9122-4128-b9ab-cb9abd23e5e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:45.386654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-406dfd73-9624-4eea-a375-7946147fd38c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:45.395318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-406dfd73-9624-4eea-a375-7946147fd38c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.717878 Oct 27 14:08:45.396637 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 45/86] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:44 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:45.424083 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-df1543c5-9122-4128-b9ab-cb9abd23e5e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:45.424574 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7a654ef5-e92f-4492-8f84-5220b20dd38b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:45.425383 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7a654ef5-e92f-4492-8f84-5220b20dd38b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:45.432786 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-df1543c5-9122-4128-b9ab-cb9abd23e5e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:45.434560 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-df1543c5-9122-4128-b9ab-cb9abd23e5e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:45.435637 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-df1543c5-9122-4128-b9ab-cb9abd23e5e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.583726 Oct 27 14:08:45.439104 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 42/87] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:44 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:08:45.442375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7a654ef5-e92f-4492-8f84-5220b20dd38b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:45.443289 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7a654ef5-e92f-4492-8f84-5220b20dd38b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:45.444363 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7a654ef5-e92f-4492-8f84-5220b20dd38b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:45.445205 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7a654ef5-e92f-4492-8f84-5220b20dd38b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:45.481343 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-87eaae4a-2955-4d01-b329-8e03c70f3ec2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:45.481951 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-87eaae4a-2955-4d01-b329-8e03c70f3ec2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:45.490763 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-87eaae4a-2955-4d01-b329-8e03c70f3ec2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:45.498626 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-87eaae4a-2955-4d01-b329-8e03c70f3ec2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:45.500026 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-87eaae4a-2955-4d01-b329-8e03c70f3ec2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:45.501235 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-87eaae4a-2955-4d01-b329-8e03c70f3ec2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:45.891367 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-87eaae4a-2955-4d01-b329-8e03c70f3ec2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:45.900039 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-87eaae4a-2955-4d01-b329-8e03c70f3ec2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.422884 Oct 27 14:08:45.909475 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 43/88] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:45 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:45.928107 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-bbc09eab-036f-49ff-8019-32f3bb6ffb0b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:45.935675 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-bbc09eab-036f-49ff-8019-32f3bb6ffb0b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:45.952856 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bbc09eab-036f-49ff-8019-32f3bb6ffb0b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:45.953577 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bbc09eab-036f-49ff-8019-32f3bb6ffb0b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:45.954570 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bbc09eab-036f-49ff-8019-32f3bb6ffb0b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:45.961364 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bbc09eab-036f-49ff-8019-32f3bb6ffb0b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:46.017952 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7a654ef5-e92f-4492-8f84-5220b20dd38b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:46.027224 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7a654ef5-e92f-4492-8f84-5220b20dd38b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.606744 Oct 27 14:08:46.032810 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 46/89] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:45 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:46.121086 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-bbc09eab-036f-49ff-8019-32f3bb6ffb0b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:46.133505 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-bbc09eab-036f-49ff-8019-32f3bb6ffb0b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1296 microversion: 2.1 time: 0.222675 Oct 27 14:08:46.135366 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 44/90] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:45 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1296 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:46.385404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-ccf7f3d4-f5ae-4473-b5f6-c00e92ccc373 req-a437d180-90f2-496e-8a46-1b1d253a0400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e12ebd-fe44-4aa9-8f5e-572d91370319", "tag": "aab79689-5599-45f7-b77c-95b865b88b1d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:46.388838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:46.388838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:08:46.397829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-ccf7f3d4-f5ae-4473-b5f6-c00e92ccc373 req-a437d180-90f2-496e-8a46-1b1d253a0400 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:46.399366 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-ccf7f3d4-f5ae-4473-b5f6-c00e92ccc373 req-a437d180-90f2-496e-8a46-1b1d253a0400 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:46.415094 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d80489f8-6925-4f77-9b22-c53c78821168 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:46.415745 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d80489f8-6925-4f77-9b22-c53c78821168 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:46.420899 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-ccf7f3d4-f5ae-4473-b5f6-c00e92ccc373 req-a437d180-90f2-496e-8a46-1b1d253a0400 service nova] Creating event network-changed:aab79689-5599-45f7-b77c-95b865b88b1d for instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 on hv-cinder-81566 Oct 27 14:08:46.422065 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d80489f8-6925-4f77-9b22-c53c78821168 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:46.422509 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d80489f8-6925-4f77-9b22-c53c78821168 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:46.423478 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d80489f8-6925-4f77-9b22-c53c78821168 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:46.423926 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d80489f8-6925-4f77-9b22-c53c78821168 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:46.428068 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-ccf7f3d4-f5ae-4473-b5f6-c00e92ccc373 req-a437d180-90f2-496e-8a46-1b1d253a0400 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046005 Oct 27 14:08:46.431465 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 47/91] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:08:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:08:46.462467 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-65a60bdc-6836-4deb-9d08-a4d33ab8a7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:46.463461 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-65a60bdc-6836-4deb-9d08-a4d33ab8a7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:46.470346 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65a60bdc-6836-4deb-9d08-a4d33ab8a7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:46.471107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65a60bdc-6836-4deb-9d08-a4d33ab8a7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:46.472227 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65a60bdc-6836-4deb-9d08-a4d33ab8a7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:46.472836 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65a60bdc-6836-4deb-9d08-a4d33ab8a7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:46.704035 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-d80489f8-6925-4f77-9b22-c53c78821168 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:46.712254 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d80489f8-6925-4f77-9b22-c53c78821168 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.302305 Oct 27 14:08:46.713372 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 45/92] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:46 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:46.723609 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-65a60bdc-6836-4deb-9d08-a4d33ab8a7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:46.732257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-65a60bdc-6836-4deb-9d08-a4d33ab8a7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:46.733778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-65a60bdc-6836-4deb-9d08-a4d33ab8a7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:46.734889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-65a60bdc-6836-4deb-9d08-a4d33ab8a7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.280552 Oct 27 14:08:46.735468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 48/93] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:46 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:08:46.916781 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c429c8e3-7142-48c3-b59b-3d9e6d24f994 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:46.917416 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c429c8e3-7142-48c3-b59b-3d9e6d24f994 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:46.923087 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c429c8e3-7142-48c3-b59b-3d9e6d24f994 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:46.923565 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c429c8e3-7142-48c3-b59b-3d9e6d24f994 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:46.924330 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c429c8e3-7142-48c3-b59b-3d9e6d24f994 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:46.924754 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c429c8e3-7142-48c3-b59b-3d9e6d24f994 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:47.050885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8978f877-ebe0-4dbb-9dad-14f75dd653b1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:47.051515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8978f877-ebe0-4dbb-9dad-14f75dd653b1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:47.058182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8978f877-ebe0-4dbb-9dad-14f75dd653b1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:47.058946 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8978f877-ebe0-4dbb-9dad-14f75dd653b1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:47.059761 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8978f877-ebe0-4dbb-9dad-14f75dd653b1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:47.060358 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8978f877-ebe0-4dbb-9dad-14f75dd653b1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:47.151505 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c429c8e3-7142-48c3-b59b-3d9e6d24f994 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:47.160067 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c429c8e3-7142-48c3-b59b-3d9e6d24f994 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.246841 Oct 27 14:08:47.161033 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 46/94] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:46 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:47.166878 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-73448219-5267-4599-9689-e134cd049b33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:47.167547 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-73448219-5267-4599-9689-e134cd049b33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:47.176313 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-73448219-5267-4599-9689-e134cd049b33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:47.176809 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-73448219-5267-4599-9689-e134cd049b33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:47.177847 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-73448219-5267-4599-9689-e134cd049b33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:47.179120 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-73448219-5267-4599-9689-e134cd049b33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:47.320487 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8978f877-ebe0-4dbb-9dad-14f75dd653b1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:47.330393 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8978f877-ebe0-4dbb-9dad-14f75dd653b1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.283005 Oct 27 14:08:47.340022 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 49/95] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:47 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:47.387720 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-73448219-5267-4599-9689-e134cd049b33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:47.395032 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-73448219-5267-4599-9689-e134cd049b33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1364 microversion: 2.1 time: 0.232607 Oct 27 14:08:47.395646 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 47/96] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:47 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:47.731025 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-10968ff3-df23-4f85-a56a-9d5972bad14f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:47.731677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-10968ff3-df23-4f85-a56a-9d5972bad14f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:47.737477 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-10968ff3-df23-4f85-a56a-9d5972bad14f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:47.737924 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-10968ff3-df23-4f85-a56a-9d5972bad14f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:47.738767 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-10968ff3-df23-4f85-a56a-9d5972bad14f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:47.739119 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-10968ff3-df23-4f85-a56a-9d5972bad14f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:47.753426 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-3d00e250-4806-453a-aaca-a24465eebee6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:47.754106 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-3d00e250-4806-453a-aaca-a24465eebee6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:47.763068 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3d00e250-4806-453a-aaca-a24465eebee6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:47.763554 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3d00e250-4806-453a-aaca-a24465eebee6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:47.764352 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3d00e250-4806-453a-aaca-a24465eebee6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:47.764789 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3d00e250-4806-453a-aaca-a24465eebee6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:47.945133 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-10968ff3-df23-4f85-a56a-9d5972bad14f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:47.950672 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-3d00e250-4806-453a-aaca-a24465eebee6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:47.952918 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-10968ff3-df23-4f85-a56a-9d5972bad14f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.227973 Oct 27 14:08:47.953680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 50/97] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:47 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:47.988365 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-3d00e250-4806-453a-aaca-a24465eebee6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:47.999872 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-3d00e250-4806-453a-aaca-a24465eebee6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:48.001076 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-3d00e250-4806-453a-aaca-a24465eebee6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.251664 Oct 27 14:08:48.003663 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 48/98] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:47 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:08:48.172202 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-dc2a5697-d007-49fe-8276-f2aaa2f8eed1 req-8ed9d7f3-d5c3-45be-a013-c509aa2080e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e098f1a-7a67-49aa-8612-ecf546da5a62", "name": "network-vif-plugged", "status": "completed", "tag": "60d5d634-d73e-43e2-9077-dd41c390011b"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:48.174178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:48.174178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:08:48.181701 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f94aff51-839c-4fe4-96aa-be71abdf8ca1 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:48.182328 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f94aff51-839c-4fe4-96aa-be71abdf8ca1 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:48.189346 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f94aff51-839c-4fe4-96aa-be71abdf8ca1 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:48.190387 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f94aff51-839c-4fe4-96aa-be71abdf8ca1 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:48.191391 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f94aff51-839c-4fe4-96aa-be71abdf8ca1 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:48.191760 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-dc2a5697-d007-49fe-8276-f2aaa2f8eed1 req-8ed9d7f3-d5c3-45be-a013-c509aa2080e6 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:48.192178 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f94aff51-839c-4fe4-96aa-be71abdf8ca1 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:48.192283 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-dc2a5697-d007-49fe-8276-f2aaa2f8eed1 req-8ed9d7f3-d5c3-45be-a013-c509aa2080e6 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:48.210246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-dc2a5697-d007-49fe-8276-f2aaa2f8eed1 req-8ed9d7f3-d5c3-45be-a013-c509aa2080e6 service nova] Creating event network-vif-plugged:60d5d634-d73e-43e2-9077-dd41c390011b for instance 1e098f1a-7a67-49aa-8612-ecf546da5a62 on hv-cinder-81566 Oct 27 14:08:48.226981 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-dc2a5697-d007-49fe-8276-f2aaa2f8eed1 req-8ed9d7f3-d5c3-45be-a013-c509aa2080e6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058268 Oct 27 14:08:48.227625 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 51/99] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:08:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:48.353620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1aca7766-96a1-419d-bb2f-dee320d7456d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:48.354890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1aca7766-96a1-419d-bb2f-dee320d7456d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:48.371078 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1aca7766-96a1-419d-bb2f-dee320d7456d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:48.372158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1aca7766-96a1-419d-bb2f-dee320d7456d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:48.384020 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1aca7766-96a1-419d-bb2f-dee320d7456d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:48.384817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1aca7766-96a1-419d-bb2f-dee320d7456d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:48.927013 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-f94aff51-839c-4fe4-96aa-be71abdf8ca1 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:48.936201 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f94aff51-839c-4fe4-96aa-be71abdf8ca1 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.761458 Oct 27 14:08:48.946827 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 49/100] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:48 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:48.956988 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-38bf4788-6ee5-4e8a-9f15-fe1ec9618858 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:48.958189 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-38bf4788-6ee5-4e8a-9f15-fe1ec9618858 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:48.969237 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-38bf4788-6ee5-4e8a-9f15-fe1ec9618858 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:48.969689 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-38bf4788-6ee5-4e8a-9f15-fe1ec9618858 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:48.970622 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-38bf4788-6ee5-4e8a-9f15-fe1ec9618858 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:48.971168 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-38bf4788-6ee5-4e8a-9f15-fe1ec9618858 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:49.040381 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1aca7766-96a1-419d-bb2f-dee320d7456d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:49.048524 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1aca7766-96a1-419d-bb2f-dee320d7456d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.703194 Oct 27 14:08:49.055377 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 52/101] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:48 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:49.063929 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-794f8f12-16f8-4cbb-8855-245bd0f2c127 req-2753794c-9140-49a1-9e5d-d31a5e503fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70957fff-2020-4c1f-8829-004a5b2cb3f8", "tag": "d3b6171c-067b-46e6-9907-3c63ab8ab975"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:49.066156 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:49.066156 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:08:49.074713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-794f8f12-16f8-4cbb-8855-245bd0f2c127 req-2753794c-9140-49a1-9e5d-d31a5e503fcb service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:49.075316 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-794f8f12-16f8-4cbb-8855-245bd0f2c127 req-2753794c-9140-49a1-9e5d-d31a5e503fcb service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:49.091963 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-794f8f12-16f8-4cbb-8855-245bd0f2c127 req-2753794c-9140-49a1-9e5d-d31a5e503fcb service nova] Creating event network-changed:d3b6171c-067b-46e6-9907-3c63ab8ab975 for instance 70957fff-2020-4c1f-8829-004a5b2cb3f8 on hv-cinder-81566 Oct 27 14:08:49.100033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-794f8f12-16f8-4cbb-8855-245bd0f2c127 req-2753794c-9140-49a1-9e5d-d31a5e503fcb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043113 Oct 27 14:08:49.103369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 53/102] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:08:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:49.113263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f14368a4-6e00-41b0-9e62-27f2dade70e5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:49.116444 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f14368a4-6e00-41b0-9e62-27f2dade70e5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:49.126216 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f14368a4-6e00-41b0-9e62-27f2dade70e5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:49.126662 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f14368a4-6e00-41b0-9e62-27f2dade70e5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:49.127947 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f14368a4-6e00-41b0-9e62-27f2dade70e5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:49.129031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f14368a4-6e00-41b0-9e62-27f2dade70e5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:49.396507 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-38bf4788-6ee5-4e8a-9f15-fe1ec9618858 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:49.418264 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-38bf4788-6ee5-4e8a-9f15-fe1ec9618858 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1364 microversion: 2.1 time: 0.471678 Oct 27 14:08:49.436082 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 50/103] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:48 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1364 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:49.448826 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-47dbcce2-13cb-4e65-b078-76272c810474 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:49.450239 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-47dbcce2-13cb-4e65-b078-76272c810474 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:49.461764 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-47dbcce2-13cb-4e65-b078-76272c810474 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:49.462599 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-47dbcce2-13cb-4e65-b078-76272c810474 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:49.464178 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-47dbcce2-13cb-4e65-b078-76272c810474 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:49.465106 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-47dbcce2-13cb-4e65-b078-76272c810474 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:49.628379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f14368a4-6e00-41b0-9e62-27f2dade70e5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:49.642524 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f14368a4-6e00-41b0-9e62-27f2dade70e5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.537455 Oct 27 14:08:49.654058 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 54/104] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:49 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:49.901810 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-47dbcce2-13cb-4e65-b078-76272c810474 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:49.918451 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-47dbcce2-13cb-4e65-b078-76272c810474 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:49.920003 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-47dbcce2-13cb-4e65-b078-76272c810474 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:49.921139 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-47dbcce2-13cb-4e65-b078-76272c810474 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.481910 Oct 27 14:08:49.922032 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 51/105] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:49 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:08:49.956842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-07ea1435-6c01-4323-9d99-8973325b30ae tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:49.957965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-07ea1435-6c01-4323-9d99-8973325b30ae tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:49.972941 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07ea1435-6c01-4323-9d99-8973325b30ae tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:49.974079 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07ea1435-6c01-4323-9d99-8973325b30ae tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:49.978240 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07ea1435-6c01-4323-9d99-8973325b30ae tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:49.978810 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07ea1435-6c01-4323-9d99-8973325b30ae tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:50.073152 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-bc7d21c6-956d-4823-98da-a6b2c4206551 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:50.075285 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-bc7d21c6-956d-4823-98da-a6b2c4206551 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:50.083766 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc7d21c6-956d-4823-98da-a6b2c4206551 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:50.085079 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc7d21c6-956d-4823-98da-a6b2c4206551 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:50.086648 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc7d21c6-956d-4823-98da-a6b2c4206551 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:50.087337 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc7d21c6-956d-4823-98da-a6b2c4206551 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:50.423357 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-07ea1435-6c01-4323-9d99-8973325b30ae tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:50.434846 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-07ea1435-6c01-4323-9d99-8973325b30ae tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.483438 Oct 27 14:08:50.435705 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 55/106] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:49 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:50.460765 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-bc7d21c6-956d-4823-98da-a6b2c4206551 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:50.479881 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-bc7d21c6-956d-4823-98da-a6b2c4206551 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.411611 Oct 27 14:08:50.480455 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 52/107] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:50 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:50.494473 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-dfd3fcd4-1ea2-4693-8e1a-d9c4164d0516 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:50.495055 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-dfd3fcd4-1ea2-4693-8e1a-d9c4164d0516 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:50.503819 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dfd3fcd4-1ea2-4693-8e1a-d9c4164d0516 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:50.504301 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dfd3fcd4-1ea2-4693-8e1a-d9c4164d0516 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:50.505390 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dfd3fcd4-1ea2-4693-8e1a-d9c4164d0516 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:50.506139 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dfd3fcd4-1ea2-4693-8e1a-d9c4164d0516 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:50.575780 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-1820f419-0080-48c6-b0fc-be010dcaa710 req-f3fed45b-42e7-4ff2-bcab-2c75e3d443c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbc567f-bc87-48cd-b910-ba46c84f914d", "tag": "766d9692-5198-4c25-aa3a-d99900cc51b5"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:50.578004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:50.578004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:08:50.587710 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-1820f419-0080-48c6-b0fc-be010dcaa710 req-f3fed45b-42e7-4ff2-bcab-2c75e3d443c8 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:50.588369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-1820f419-0080-48c6-b0fc-be010dcaa710 req-f3fed45b-42e7-4ff2-bcab-2c75e3d443c8 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:50.608908 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-1820f419-0080-48c6-b0fc-be010dcaa710 req-f3fed45b-42e7-4ff2-bcab-2c75e3d443c8 service nova] Creating event network-changed:766d9692-5198-4c25-aa3a-d99900cc51b5 for instance adbc567f-bc87-48cd-b910-ba46c84f914d on hv-cinder-81566 Oct 27 14:08:50.621555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-1820f419-0080-48c6-b0fc-be010dcaa710 req-f3fed45b-42e7-4ff2-bcab-2c75e3d443c8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174642 Oct 27 14:08:50.622356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 56/108] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:08:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:50.662453 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b4d5d0fe-325a-41ae-9332-6115ab93a735 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:50.663996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b4d5d0fe-325a-41ae-9332-6115ab93a735 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:50.667171 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-dfd3fcd4-1ea2-4693-8e1a-d9c4164d0516 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:50.670788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b4d5d0fe-325a-41ae-9332-6115ab93a735 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:50.671263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b4d5d0fe-325a-41ae-9332-6115ab93a735 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:50.672048 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b4d5d0fe-325a-41ae-9332-6115ab93a735 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:50.672473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b4d5d0fe-325a-41ae-9332-6115ab93a735 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:50.676343 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-dfd3fcd4-1ea2-4693-8e1a-d9c4164d0516 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1364 microversion: 2.1 time: 0.193503 Oct 27 14:08:50.677064 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 53/109] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:50 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:50.810615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b4d5d0fe-325a-41ae-9332-6115ab93a735 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:50.817844 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b4d5d0fe-325a-41ae-9332-6115ab93a735 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.160383 Oct 27 14:08:50.818412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 57/110] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:50 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:50.939709 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-5db16aba-b86e-4d65-bb42-bce189694782 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:50.940315 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-5db16aba-b86e-4d65-bb42-bce189694782 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:50.946579 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5db16aba-b86e-4d65-bb42-bce189694782 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:50.947033 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5db16aba-b86e-4d65-bb42-bce189694782 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:50.947831 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5db16aba-b86e-4d65-bb42-bce189694782 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:50.948274 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5db16aba-b86e-4d65-bb42-bce189694782 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:51.093833 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-5db16aba-b86e-4d65-bb42-bce189694782 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:51.103339 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-5db16aba-b86e-4d65-bb42-bce189694782 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:51.104826 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-5db16aba-b86e-4d65-bb42-bce189694782 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:51.106309 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-5db16aba-b86e-4d65-bb42-bce189694782 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.170121 Oct 27 14:08:51.107296 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 54/111] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:50 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:08:51.460995 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-da13616f-3515-4720-9622-ac809fac2d25 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:51.462094 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-da13616f-3515-4720-9622-ac809fac2d25 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:51.470192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da13616f-3515-4720-9622-ac809fac2d25 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:51.470767 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da13616f-3515-4720-9622-ac809fac2d25 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:51.471679 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da13616f-3515-4720-9622-ac809fac2d25 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:51.472211 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da13616f-3515-4720-9622-ac809fac2d25 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:51.501283 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-32f03d79-3dbf-4308-b576-b18d19bf4723 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:51.502468 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-32f03d79-3dbf-4308-b576-b18d19bf4723 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:51.515975 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-32f03d79-3dbf-4308-b576-b18d19bf4723 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:51.519069 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-32f03d79-3dbf-4308-b576-b18d19bf4723 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:51.521261 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-32f03d79-3dbf-4308-b576-b18d19bf4723 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:51.522809 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-32f03d79-3dbf-4308-b576-b18d19bf4723 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:51.723363 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-da13616f-3515-4720-9622-ac809fac2d25 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:51.731021 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-32f03d79-3dbf-4308-b576-b18d19bf4723 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:51.731535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-da13616f-3515-4720-9622-ac809fac2d25 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.279781 Oct 27 14:08:51.732122 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 58/112] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:51 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:51.736847 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9dbe4ef7-2ef3-43ea-bbdd-a4beac48ba1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:51.737521 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9dbe4ef7-2ef3-43ea-bbdd-a4beac48ba1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:51.743698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dbe4ef7-2ef3-43ea-bbdd-a4beac48ba1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:51.744252 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dbe4ef7-2ef3-43ea-bbdd-a4beac48ba1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:51.745118 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dbe4ef7-2ef3-43ea-bbdd-a4beac48ba1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:51.745753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dbe4ef7-2ef3-43ea-bbdd-a4beac48ba1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:51.746612 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-32f03d79-3dbf-4308-b576-b18d19bf4723 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.252059 Oct 27 14:08:51.747850 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 55/113] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:51 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:51.835302 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-20a2df73-c22f-4d78-8c3b-cd1419ec73ba tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:51.835918 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-20a2df73-c22f-4d78-8c3b-cd1419ec73ba tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:51.842425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-20a2df73-c22f-4d78-8c3b-cd1419ec73ba tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:51.843099 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-20a2df73-c22f-4d78-8c3b-cd1419ec73ba tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:51.844099 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-20a2df73-c22f-4d78-8c3b-cd1419ec73ba tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:51.844857 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-20a2df73-c22f-4d78-8c3b-cd1419ec73ba tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:52.456621 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9dbe4ef7-2ef3-43ea-bbdd-a4beac48ba1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:52.471826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9dbe4ef7-2ef3-43ea-bbdd-a4beac48ba1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1364 microversion: 2.1 time: 0.738069 Oct 27 14:08:52.472409 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-20a2df73-c22f-4d78-8c3b-cd1419ec73ba tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:52.472822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 59/114] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:51 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1364 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:52.478362 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3420f538-61bf-44a6-be44-42017574373c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:52.479071 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3420f538-61bf-44a6-be44-42017574373c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:52.485623 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3420f538-61bf-44a6-be44-42017574373c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:52.486330 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3420f538-61bf-44a6-be44-42017574373c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:52.487116 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3420f538-61bf-44a6-be44-42017574373c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:52.487591 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3420f538-61bf-44a6-be44-42017574373c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:52.490163 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-20a2df73-c22f-4d78-8c3b-cd1419ec73ba tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1317 microversion: 2.1 time: 0.659261 Oct 27 14:08:52.492011 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 56/115] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:51 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:52.643587 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-76385a6b-9324-4e0c-83bf-d400894ffbe9 req-bb6d0b28-211c-4e2f-a727-4a475260fa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396ab30c-d8d7-48b2-a476-fe2cd2d21ce8", "tag": "15887899-2093-4823-88fd-9157f73d58e7"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:52.645631 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:52.645631 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:08:52.653324 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-76385a6b-9324-4e0c-83bf-d400894ffbe9 req-bb6d0b28-211c-4e2f-a727-4a475260fa06 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:52.653826 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-76385a6b-9324-4e0c-83bf-d400894ffbe9 req-bb6d0b28-211c-4e2f-a727-4a475260fa06 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:52.667055 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-76385a6b-9324-4e0c-83bf-d400894ffbe9 req-bb6d0b28-211c-4e2f-a727-4a475260fa06 service nova] Creating event network-changed:15887899-2093-4823-88fd-9157f73d58e7 for instance 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 on hv-cinder-81566 Oct 27 14:08:52.672166 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-76385a6b-9324-4e0c-83bf-d400894ffbe9 req-bb6d0b28-211c-4e2f-a727-4a475260fa06 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032196 Oct 27 14:08:52.673796 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 57/116] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:08:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:08:52.749055 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f279d1e6-59b6-475a-8192-26b51a45ebf5 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:52.750380 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f279d1e6-59b6-475a-8192-26b51a45ebf5 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:52.757369 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f279d1e6-59b6-475a-8192-26b51a45ebf5 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:52.758089 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f279d1e6-59b6-475a-8192-26b51a45ebf5 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:52.759398 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f279d1e6-59b6-475a-8192-26b51a45ebf5 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:52.759841 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f279d1e6-59b6-475a-8192-26b51a45ebf5 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:52.948724 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3420f538-61bf-44a6-be44-42017574373c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:52.968920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3420f538-61bf-44a6-be44-42017574373c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:52.970555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3420f538-61bf-44a6-be44-42017574373c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:52.971959 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3420f538-61bf-44a6-be44-42017574373c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.497882 Oct 27 14:08:52.972761 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 60/117] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:52 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:08:52.978073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e87d9ddf-29d6-44e4-81b4-106af6e98bbe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:52.979390 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e87d9ddf-29d6-44e4-81b4-106af6e98bbe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:52.986012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e87d9ddf-29d6-44e4-81b4-106af6e98bbe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:52.987251 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e87d9ddf-29d6-44e4-81b4-106af6e98bbe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:52.988556 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e87d9ddf-29d6-44e4-81b4-106af6e98bbe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:52.989137 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e87d9ddf-29d6-44e4-81b4-106af6e98bbe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:53.480602 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-f279d1e6-59b6-475a-8192-26b51a45ebf5 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:53.492808 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f279d1e6-59b6-475a-8192-26b51a45ebf5 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1314 microversion: 2.1 time: 0.744137 Oct 27 14:08:53.494713 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 58/118] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:52 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:53.506003 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4e2fa8a2-6dcf-449b-96bc-8300095bafe3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:53.508163 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4e2fa8a2-6dcf-449b-96bc-8300095bafe3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:53.524369 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e2fa8a2-6dcf-449b-96bc-8300095bafe3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:53.526589 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e2fa8a2-6dcf-449b-96bc-8300095bafe3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:53.527769 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e2fa8a2-6dcf-449b-96bc-8300095bafe3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:53.531707 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e2fa8a2-6dcf-449b-96bc-8300095bafe3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:53.734322 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e87d9ddf-29d6-44e4-81b4-106af6e98bbe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:53.745903 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e87d9ddf-29d6-44e4-81b4-106af6e98bbe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.769349 Oct 27 14:08:53.749701 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 61/119] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:52 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:53.763702 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-07a739bf-d761-4290-a163-9c46b1a8c74b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:53.766172 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-07a739bf-d761-4290-a163-9c46b1a8c74b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:53.782973 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07a739bf-d761-4290-a163-9c46b1a8c74b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:53.783474 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07a739bf-d761-4290-a163-9c46b1a8c74b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:53.785163 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07a739bf-d761-4290-a163-9c46b1a8c74b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:53.785503 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07a739bf-d761-4290-a163-9c46b1a8c74b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:54.102883 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4e2fa8a2-6dcf-449b-96bc-8300095bafe3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:54.116313 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4e2fa8a2-6dcf-449b-96bc-8300095bafe3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1364 microversion: 2.1 time: 0.619971 Oct 27 14:08:54.117330 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 59/120] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:53 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1364 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:54.123078 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c52e07c8-597a-4971-802a-a756221367ce tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:54.124233 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c52e07c8-597a-4971-802a-a756221367ce tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:54.133426 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c52e07c8-597a-4971-802a-a756221367ce tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:54.134258 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c52e07c8-597a-4971-802a-a756221367ce tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:54.135324 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c52e07c8-597a-4971-802a-a756221367ce tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:54.135969 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c52e07c8-597a-4971-802a-a756221367ce tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:54.302887 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-07a739bf-d761-4290-a163-9c46b1a8c74b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:54.315865 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-07a739bf-d761-4290-a163-9c46b1a8c74b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1507 microversion: 2.1 time: 0.564126 Oct 27 14:08:54.317268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 62/121] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:53 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1507 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:54.415857 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c52e07c8-597a-4971-802a-a756221367ce tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:54.428113 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c52e07c8-597a-4971-802a-a756221367ce tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:54.430335 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c52e07c8-597a-4971-802a-a756221367ce tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:54.431507 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c52e07c8-597a-4971-802a-a756221367ce tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.312906 Oct 27 14:08:54.432283 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 60/122] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:54 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:08:54.512207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a6afb81f-9006-4b3a-a957-31fee0548094 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:54.512819 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a6afb81f-9006-4b3a-a957-31fee0548094 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:54.526294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a6afb81f-9006-4b3a-a957-31fee0548094 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:54.527033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a6afb81f-9006-4b3a-a957-31fee0548094 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:54.528131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a6afb81f-9006-4b3a-a957-31fee0548094 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:54.528816 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a6afb81f-9006-4b3a-a957-31fee0548094 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:54.744247 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a6afb81f-9006-4b3a-a957-31fee0548094 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:54.752784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a6afb81f-9006-4b3a-a957-31fee0548094 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1500 microversion: 2.1 time: 0.244787 Oct 27 14:08:54.753638 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 63/123] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:54 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1500 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:54.763568 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a6328e48-c335-47c2-a018-fdfd2fd10ddf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:54.764041 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a6328e48-c335-47c2-a018-fdfd2fd10ddf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:54.771377 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a6328e48-c335-47c2-a018-fdfd2fd10ddf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:54.771716 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a6328e48-c335-47c2-a018-fdfd2fd10ddf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:54.773103 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a6328e48-c335-47c2-a018-fdfd2fd10ddf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:54.783195 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a6328e48-c335-47c2-a018-fdfd2fd10ddf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:54.938352 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a6328e48-c335-47c2-a018-fdfd2fd10ddf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:54.947895 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a6328e48-c335-47c2-a018-fdfd2fd10ddf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.188029 Oct 27 14:08:54.948558 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 61/124] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:54 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:55.135258 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-eb6c61d9-3387-4277-915c-b1a99d710a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:55.135875 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-eb6c61d9-3387-4277-915c-b1a99d710a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:55.143740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb6c61d9-3387-4277-915c-b1a99d710a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:55.144438 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb6c61d9-3387-4277-915c-b1a99d710a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:55.145625 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb6c61d9-3387-4277-915c-b1a99d710a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:55.146413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb6c61d9-3387-4277-915c-b1a99d710a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:55.315677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-eb6c61d9-3387-4277-915c-b1a99d710a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:55.328009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-eb6c61d9-3387-4277-915c-b1a99d710a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1364 microversion: 2.1 time: 0.197626 Oct 27 14:08:55.328595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 64/125] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:55 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:55.450947 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-75f981cb-fa3c-4539-b537-656d934d03f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:55.452011 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-75f981cb-fa3c-4539-b537-656d934d03f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:55.458562 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-75f981cb-fa3c-4539-b537-656d934d03f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:55.459112 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-75f981cb-fa3c-4539-b537-656d934d03f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:55.461286 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-75f981cb-fa3c-4539-b537-656d934d03f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:55.462372 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-75f981cb-fa3c-4539-b537-656d934d03f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:55.630924 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-75f981cb-fa3c-4539-b537-656d934d03f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:55.643902 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-75f981cb-fa3c-4539-b537-656d934d03f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:55.645637 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-75f981cb-fa3c-4539-b537-656d934d03f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:55.647221 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-75f981cb-fa3c-4539-b537-656d934d03f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.200526 Oct 27 14:08:55.648358 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 62/126] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:55 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:08:55.856488 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-97182ff5-6ea3-45c8-af74-14c06e0fae8b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6c2d59a-f0f4-4f52-9356-c3efc642a735"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:55.857703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-97182ff5-6ea3-45c8-af74-14c06e0fae8b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:55.863745 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-97182ff5-6ea3-45c8-af74-14c06e0fae8b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:55.864276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-97182ff5-6ea3-45c8-af74-14c06e0fae8b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:55.865130 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-97182ff5-6ea3-45c8-af74-14c06e0fae8b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:55.865560 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-97182ff5-6ea3-45c8-af74-14c06e0fae8b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:55.965312 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-19f0c05e-ee77-46aa-92b5-8070d56b4782 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:55.966441 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-19f0c05e-ee77-46aa-92b5-8070d56b4782 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:55.974200 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-19f0c05e-ee77-46aa-92b5-8070d56b4782 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:55.977777 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-19f0c05e-ee77-46aa-92b5-8070d56b4782 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:55.980973 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-19f0c05e-ee77-46aa-92b5-8070d56b4782 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:55.981783 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-19f0c05e-ee77-46aa-92b5-8070d56b4782 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:56.310548 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-19f0c05e-ee77-46aa-92b5-8070d56b4782 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:56.319828 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-19f0c05e-ee77-46aa-92b5-8070d56b4782 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.357979 Oct 27 14:08:56.320881 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 63/127] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:55 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:08:56.325581 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-68a4bada-ee6b-40bd-a530-f12de34cac04 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79815101-6a39-4148-bd11-9727b3d58c6b"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:56.326985 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-68a4bada-ee6b-40bd-a530-f12de34cac04 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:56.333903 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-68a4bada-ee6b-40bd-a530-f12de34cac04 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:56.334648 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-68a4bada-ee6b-40bd-a530-f12de34cac04 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:56.336283 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-68a4bada-ee6b-40bd-a530-f12de34cac04 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:56.336868 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-68a4bada-ee6b-40bd-a530-f12de34cac04 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:56.356724 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-97182ff5-6ea3-45c8-af74-14c06e0fae8b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "POST /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504028 Oct 27 14:08:56.358495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 65/128] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:08:55 2021] POST /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:56.382213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b34b669c-9f53-4aa2-9441-7402a965ae76 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:56.382901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b34b669c-9f53-4aa2-9441-7402a965ae76 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:56.390833 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b34b669c-9f53-4aa2-9441-7402a965ae76 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:56.391478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b34b669c-9f53-4aa2-9441-7402a965ae76 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:56.393188 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b34b669c-9f53-4aa2-9441-7402a965ae76 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:56.393834 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b34b669c-9f53-4aa2-9441-7402a965ae76 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:56.582594 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b34b669c-9f53-4aa2-9441-7402a965ae76 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:56.592211 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b34b669c-9f53-4aa2-9441-7402a965ae76 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1364 microversion: 2.1 time: 0.231228 Oct 27 14:08:56.593801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 66/129] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:56 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:56.667409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c7deb5ba-7ad8-4b78-b4eb-f8bf75462ac3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:56.668192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c7deb5ba-7ad8-4b78-b4eb-f8bf75462ac3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:56.674259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c7deb5ba-7ad8-4b78-b4eb-f8bf75462ac3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:56.674706 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c7deb5ba-7ad8-4b78-b4eb-f8bf75462ac3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:56.675772 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c7deb5ba-7ad8-4b78-b4eb-f8bf75462ac3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:56.679913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c7deb5ba-7ad8-4b78-b4eb-f8bf75462ac3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:56.870809 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c7deb5ba-7ad8-4b78-b4eb-f8bf75462ac3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:56.879999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c7deb5ba-7ad8-4b78-b4eb-f8bf75462ac3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:56.882443 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c7deb5ba-7ad8-4b78-b4eb-f8bf75462ac3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:56.883584 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c7deb5ba-7ad8-4b78-b4eb-f8bf75462ac3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.220911 Oct 27 14:08:56.884456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 67/130] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:56 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:08:56.932071 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-68a4bada-ee6b-40bd-a530-f12de34cac04 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "POST /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609805 Oct 27 14:08:56.932934 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 64/131] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:08:56 2021] POST /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab/os-volume_attachments => generated 194 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:57.337427 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-af537517-4060-4190-83f4-83ebf3fd10e3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:57.338709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-af537517-4060-4190-83f4-83ebf3fd10e3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:57.356723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-af537517-4060-4190-83f4-83ebf3fd10e3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:57.358891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-af537517-4060-4190-83f4-83ebf3fd10e3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:57.361189 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-af537517-4060-4190-83f4-83ebf3fd10e3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:57.361756 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-af537517-4060-4190-83f4-83ebf3fd10e3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:57.501168 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-c98bc0c8-54dc-405b-a226-59431c27c774 req-e772eeda-0018-4340-9609-f65c5dca0c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70957fff-2020-4c1f-8829-004a5b2cb3f8", "name": "network-vif-plugged", "status": "completed", "tag": "d3b6171c-067b-46e6-9907-3c63ab8ab975"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:57.502755 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:57.502755 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:08:57.520968 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-c98bc0c8-54dc-405b-a226-59431c27c774 req-e772eeda-0018-4340-9609-f65c5dca0c59 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:57.521724 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-c98bc0c8-54dc-405b-a226-59431c27c774 req-e772eeda-0018-4340-9609-f65c5dca0c59 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:57.534534 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-c98bc0c8-54dc-405b-a226-59431c27c774 req-e772eeda-0018-4340-9609-f65c5dca0c59 service nova] Creating event network-vif-plugged:d3b6171c-067b-46e6-9907-3c63ab8ab975 for instance 70957fff-2020-4c1f-8829-004a5b2cb3f8 on hv-cinder-81566 Oct 27 14:08:57.540851 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-c98bc0c8-54dc-405b-a226-59431c27c774 req-e772eeda-0018-4340-9609-f65c5dca0c59 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050954 Oct 27 14:08:57.541666 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 65/132] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:08:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:08:57.545169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-af537517-4060-4190-83f4-83ebf3fd10e3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:57.565802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-af537517-4060-4190-83f4-83ebf3fd10e3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.232419 Oct 27 14:08:57.570580 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 68/133] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:57 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:57.611829 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-431aa138-3304-48b5-9b68-ec38209516ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:57.612518 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-431aa138-3304-48b5-9b68-ec38209516ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:57.622657 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-431aa138-3304-48b5-9b68-ec38209516ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:57.623318 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-431aa138-3304-48b5-9b68-ec38209516ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:57.626195 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-431aa138-3304-48b5-9b68-ec38209516ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:57.626887 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-431aa138-3304-48b5-9b68-ec38209516ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:57.842910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-431aa138-3304-48b5-9b68-ec38209516ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:57.851288 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-431aa138-3304-48b5-9b68-ec38209516ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1364 microversion: 2.1 time: 0.242700 Oct 27 14:08:57.851851 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 66/134] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:57 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:57.901893 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9c202fa4-258a-4957-a000-779dd4ba0d02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:57.902482 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9c202fa4-258a-4957-a000-779dd4ba0d02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:57.912234 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9c202fa4-258a-4957-a000-779dd4ba0d02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:57.912675 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9c202fa4-258a-4957-a000-779dd4ba0d02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:57.914226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9c202fa4-258a-4957-a000-779dd4ba0d02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:57.914644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9c202fa4-258a-4957-a000-779dd4ba0d02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:58.099027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9c202fa4-258a-4957-a000-779dd4ba0d02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:58.107840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9c202fa4-258a-4957-a000-779dd4ba0d02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:58.109462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9c202fa4-258a-4957-a000-779dd4ba0d02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:58.110827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9c202fa4-258a-4957-a000-779dd4ba0d02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.212818 Oct 27 14:08:58.111990 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 69/135] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:57 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:08:58.584031 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e37ee087-0e69-4c3e-a384-5bcfbd3a06e1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:58.585818 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e37ee087-0e69-4c3e-a384-5bcfbd3a06e1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:58.597284 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e37ee087-0e69-4c3e-a384-5bcfbd3a06e1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:58.600192 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e37ee087-0e69-4c3e-a384-5bcfbd3a06e1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:58.602328 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e37ee087-0e69-4c3e-a384-5bcfbd3a06e1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:58.606966 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e37ee087-0e69-4c3e-a384-5bcfbd3a06e1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:58.793562 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e37ee087-0e69-4c3e-a384-5bcfbd3a06e1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:58.801633 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e37ee087-0e69-4c3e-a384-5bcfbd3a06e1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1321 microversion: 2.1 time: 0.222325 Oct 27 14:08:58.802202 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 67/136] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:58 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:58.869121 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fea2f1d3-db13-475d-802f-50baeadfb18e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:58.869864 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fea2f1d3-db13-475d-802f-50baeadfb18e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:58.877182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fea2f1d3-db13-475d-802f-50baeadfb18e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:58.877885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fea2f1d3-db13-475d-802f-50baeadfb18e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:58.878843 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fea2f1d3-db13-475d-802f-50baeadfb18e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:58.879277 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fea2f1d3-db13-475d-802f-50baeadfb18e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:59.134845 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e74c086a-d49f-428a-b7c7-9ff00fc172ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:59.135756 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e74c086a-d49f-428a-b7c7-9ff00fc172ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:59.144557 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e74c086a-d49f-428a-b7c7-9ff00fc172ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:59.145071 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e74c086a-d49f-428a-b7c7-9ff00fc172ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:59.145940 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e74c086a-d49f-428a-b7c7-9ff00fc172ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:59.146619 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e74c086a-d49f-428a-b7c7-9ff00fc172ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:59.304493 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fea2f1d3-db13-475d-802f-50baeadfb18e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:59.318159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fea2f1d3-db13-475d-802f-50baeadfb18e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1364 microversion: 2.1 time: 0.454077 Oct 27 14:08:59.331586 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 70/137] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:58 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1364 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:08:59.367420 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e74c086a-d49f-428a-b7c7-9ff00fc172ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:59.373266 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e74c086a-d49f-428a-b7c7-9ff00fc172ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:59.376198 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e74c086a-d49f-428a-b7c7-9ff00fc172ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:08:59.377743 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e74c086a-d49f-428a-b7c7-9ff00fc172ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.251064 Oct 27 14:08:59.378526 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 68/138] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:08:59 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:08:59.572668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-00d2d86d-c93d-46b2-b14d-d12e5d33ed52 req-9009bd9b-2938-4d83-97cb-3e0162e1f8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396ab30c-d8d7-48b2-a476-fe2cd2d21ce8", "name": "network-vif-plugged", "status": "completed", "tag": "15887899-2093-4823-88fd-9157f73d58e7"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:08:59.574515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:08:59.574515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:08:59.582085 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-00d2d86d-c93d-46b2-b14d-d12e5d33ed52 req-9009bd9b-2938-4d83-97cb-3e0162e1f8b6 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:59.582519 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-00d2d86d-c93d-46b2-b14d-d12e5d33ed52 req-9009bd9b-2938-4d83-97cb-3e0162e1f8b6 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:59.595417 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-00d2d86d-c93d-46b2-b14d-d12e5d33ed52 req-9009bd9b-2938-4d83-97cb-3e0162e1f8b6 service nova] Creating event network-vif-plugged:15887899-2093-4823-88fd-9157f73d58e7 for instance 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 on hv-cinder-81566 Oct 27 14:08:59.601482 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-00d2d86d-c93d-46b2-b14d-d12e5d33ed52 req-9009bd9b-2938-4d83-97cb-3e0162e1f8b6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032448 Oct 27 14:08:59.602116 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 71/139] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:08:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:08:59.818964 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8520d425-62cd-40a5-ba33-f2fe0ff87795 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:08:59.819630 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-8520d425-62cd-40a5-ba33-f2fe0ff87795 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:08:59.826894 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8520d425-62cd-40a5-ba33-f2fe0ff87795 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:59.827626 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8520d425-62cd-40a5-ba33-f2fe0ff87795 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:08:59.828592 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8520d425-62cd-40a5-ba33-f2fe0ff87795 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:08:59.829089 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8520d425-62cd-40a5-ba33-f2fe0ff87795 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:00.022144 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-8520d425-62cd-40a5-ba33-f2fe0ff87795 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:00.030353 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-8520d425-62cd-40a5-ba33-f2fe0ff87795 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1514 microversion: 2.1 time: 0.215219 Oct 27 14:09:00.031237 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 69/140] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:08:59 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:00.052244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2ca78202-0ff2-4617-9672-797f95a9069c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:00.052244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2ca78202-0ff2-4617-9672-797f95a9069c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:00.059021 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2ca78202-0ff2-4617-9672-797f95a9069c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:00.059688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2ca78202-0ff2-4617-9672-797f95a9069c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:00.060540 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2ca78202-0ff2-4617-9672-797f95a9069c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:00.061130 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2ca78202-0ff2-4617-9672-797f95a9069c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:00.088634 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-2ca78202-0ff2-4617-9672-797f95a9069c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lazy-loading 'flavor' on Instance uuid 70957fff-2020-4c1f-8829-004a5b2cb3f8 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:09:00.211777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2ca78202-0ff2-4617-9672-797f95a9069c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "POST /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8/action" status: 200 len: 32 microversion: 2.1 time: 0.167253 Oct 27 14:09:00.212695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 72/141] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:00 2021] POST /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:00.223852 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-89f04975-fc55-487e-a5e8-6bc63964072a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:00.224451 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-89f04975-fc55-487e-a5e8-6bc63964072a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:00.233914 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-89f04975-fc55-487e-a5e8-6bc63964072a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:00.234296 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-89f04975-fc55-487e-a5e8-6bc63964072a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:00.235123 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-89f04975-fc55-487e-a5e8-6bc63964072a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:00.235959 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-89f04975-fc55-487e-a5e8-6bc63964072a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:00.339848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ead5416f-f20e-41eb-9089-969276c1d2e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:00.341121 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ead5416f-f20e-41eb-9089-969276c1d2e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:00.347595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ead5416f-f20e-41eb-9089-969276c1d2e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:00.348049 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ead5416f-f20e-41eb-9089-969276c1d2e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:00.348933 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ead5416f-f20e-41eb-9089-969276c1d2e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:00.349707 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ead5416f-f20e-41eb-9089-969276c1d2e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:00.500928 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-89f04975-fc55-487e-a5e8-6bc63964072a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:00.511897 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-89f04975-fc55-487e-a5e8-6bc63964072a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.292471 Oct 27 14:09:00.513369 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 70/142] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:00 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:00.518546 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-25f1efbb-9c25-47cd-8c50-55dc2b45962c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:00.519248 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-25f1efbb-9c25-47cd-8c50-55dc2b45962c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:00.527356 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-25f1efbb-9c25-47cd-8c50-55dc2b45962c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:00.528218 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-25f1efbb-9c25-47cd-8c50-55dc2b45962c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:00.530001 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-25f1efbb-9c25-47cd-8c50-55dc2b45962c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:00.530773 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-25f1efbb-9c25-47cd-8c50-55dc2b45962c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:00.661428 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ead5416f-f20e-41eb-9089-969276c1d2e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:00.683303 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ead5416f-f20e-41eb-9089-969276c1d2e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1364 microversion: 2.1 time: 0.345532 Oct 27 14:09:00.683928 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 73/143] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:00 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1364 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:00.853109 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-25f1efbb-9c25-47cd-8c50-55dc2b45962c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:00.868566 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-25f1efbb-9c25-47cd-8c50-55dc2b45962c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:00.871927 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-25f1efbb-9c25-47cd-8c50-55dc2b45962c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:00.873308 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-25f1efbb-9c25-47cd-8c50-55dc2b45962c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.358615 Oct 27 14:09:00.874431 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 71/144] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:09:00 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:09:01.555919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-92d67801-b345-4e53-a99c-a0e2fa100da4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:01.557240 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-92d67801-b345-4e53-a99c-a0e2fa100da4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:01.568129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92d67801-b345-4e53-a99c-a0e2fa100da4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:01.571675 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92d67801-b345-4e53-a99c-a0e2fa100da4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:01.574734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92d67801-b345-4e53-a99c-a0e2fa100da4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:01.575441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92d67801-b345-4e53-a99c-a0e2fa100da4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:01.626587 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-541dc2d3-1bbd-4746-b03e-88bebdedbb12 req-4dde2fe9-0f41-4755-9493-4d82e721f28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbc567f-bc87-48cd-b910-ba46c84f914d", "name": "network-vif-plugged", "status": "completed", "tag": "766d9692-5198-4c25-aa3a-d99900cc51b5"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:01.630718 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:01.630718 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:09:01.666945 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-541dc2d3-1bbd-4746-b03e-88bebdedbb12 req-4dde2fe9-0f41-4755-9493-4d82e721f28b service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:01.670268 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-541dc2d3-1bbd-4746-b03e-88bebdedbb12 req-4dde2fe9-0f41-4755-9493-4d82e721f28b service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:01.698271 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-541dc2d3-1bbd-4746-b03e-88bebdedbb12 req-4dde2fe9-0f41-4755-9493-4d82e721f28b service nova] Creating event network-vif-plugged:766d9692-5198-4c25-aa3a-d99900cc51b5 for instance adbc567f-bc87-48cd-b910-ba46c84f914d on hv-cinder-81566 Oct 27 14:09:01.739943 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-541dc2d3-1bbd-4746-b03e-88bebdedbb12 req-4dde2fe9-0f41-4755-9493-4d82e721f28b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105703 Oct 27 14:09:01.743876 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 72/145] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:01.776581 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4e76ac33-856d-4cb5-a54c-abb51622f849 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:01.778877 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4e76ac33-856d-4cb5-a54c-abb51622f849 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:01.814184 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e76ac33-856d-4cb5-a54c-abb51622f849 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:01.814645 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e76ac33-856d-4cb5-a54c-abb51622f849 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:01.815479 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e76ac33-856d-4cb5-a54c-abb51622f849 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:01.818385 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e76ac33-856d-4cb5-a54c-abb51622f849 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:01.840066 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-92d67801-b345-4e53-a99c-a0e2fa100da4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:01.856911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-92d67801-b345-4e53-a99c-a0e2fa100da4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.317373 Oct 27 14:09:01.857598 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 74/146] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:01 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:01.893880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a4e4adac-73f1-4ea9-b1fb-dddd4cd3d814 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:01.894541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a4e4adac-73f1-4ea9-b1fb-dddd4cd3d814 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:01.916020 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4e4adac-73f1-4ea9-b1fb-dddd4cd3d814 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:01.916465 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4e4adac-73f1-4ea9-b1fb-dddd4cd3d814 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:01.921712 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4e4adac-73f1-4ea9-b1fb-dddd4cd3d814 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:01.922189 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4e4adac-73f1-4ea9-b1fb-dddd4cd3d814 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:02.201779 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4e76ac33-856d-4cb5-a54c-abb51622f849 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:02.210494 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4e76ac33-856d-4cb5-a54c-abb51622f849 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1549 microversion: 2.1 time: 0.463956 Oct 27 14:09:02.211326 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 73/147] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:01 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1549 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:02.223676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a4e4adac-73f1-4ea9-b1fb-dddd4cd3d814 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:02.231648 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8f1d235d-8662-49fb-8977-62a7add02374 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:02.232495 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-8f1d235d-8662-49fb-8977-62a7add02374 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:02.232622 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a4e4adac-73f1-4ea9-b1fb-dddd4cd3d814 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:02.243744 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a4e4adac-73f1-4ea9-b1fb-dddd4cd3d814 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:02.244996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a4e4adac-73f1-4ea9-b1fb-dddd4cd3d814 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.355675 Oct 27 14:09:02.245579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 75/148] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:09:01 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:09:02.247852 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8f1d235d-8662-49fb-8977-62a7add02374 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:02.248296 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8f1d235d-8662-49fb-8977-62a7add02374 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:02.249067 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8f1d235d-8662-49fb-8977-62a7add02374 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:02.249491 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8f1d235d-8662-49fb-8977-62a7add02374 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:02.340719 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-8f1d235d-8662-49fb-8977-62a7add02374 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116180 Oct 27 14:09:02.341306 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 74/149] 10.222.0.85 () {58 vars in 1274 bytes} [Wed Oct 27 14:09:02 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:09:02.873941 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f5e4b138-6bd5-48ae-84a0-f96a64dc2e2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:02.874652 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f5e4b138-6bd5-48ae-84a0-f96a64dc2e2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:02.881418 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f5e4b138-6bd5-48ae-84a0-f96a64dc2e2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:02.882356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f5e4b138-6bd5-48ae-84a0-f96a64dc2e2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:02.883759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f5e4b138-6bd5-48ae-84a0-f96a64dc2e2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:02.884927 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f5e4b138-6bd5-48ae-84a0-f96a64dc2e2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:03.174181 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f5e4b138-6bd5-48ae-84a0-f96a64dc2e2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:03.186208 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f5e4b138-6bd5-48ae-84a0-f96a64dc2e2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.316224 Oct 27 14:09:03.187102 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 76/150] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:02 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:03.268603 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-067ebdfe-aaea-423f-9848-387eb512af2f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:03.268603 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-067ebdfe-aaea-423f-9848-387eb512af2f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:03.273856 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-067ebdfe-aaea-423f-9848-387eb512af2f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:03.276262 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-067ebdfe-aaea-423f-9848-387eb512af2f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:03.278643 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-067ebdfe-aaea-423f-9848-387eb512af2f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:03.279865 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-067ebdfe-aaea-423f-9848-387eb512af2f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:03.648915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-067ebdfe-aaea-423f-9848-387eb512af2f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:03.658982 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-067ebdfe-aaea-423f-9848-387eb512af2f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:03.660817 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-067ebdfe-aaea-423f-9848-387eb512af2f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:03.662134 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-067ebdfe-aaea-423f-9848-387eb512af2f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.402479 Oct 27 14:09:03.662739 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 75/151] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:09:03 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:09:03.781537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-ab05bda7-29da-439a-a581-ae12ab1da59b req-834a1f76-b01e-445f-a433-5e1212fe303c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e12ebd-fe44-4aa9-8f5e-572d91370319", "name": "network-vif-plugged", "status": "completed", "tag": "aab79689-5599-45f7-b77c-95b865b88b1d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:03.783383 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:03.783383 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:09:03.798354 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-ab05bda7-29da-439a-a581-ae12ab1da59b req-834a1f76-b01e-445f-a433-5e1212fe303c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:03.798881 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-ab05bda7-29da-439a-a581-ae12ab1da59b req-834a1f76-b01e-445f-a433-5e1212fe303c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:03.827385 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-ab05bda7-29da-439a-a581-ae12ab1da59b req-834a1f76-b01e-445f-a433-5e1212fe303c service nova] Creating event network-vif-plugged:aab79689-5599-45f7-b77c-95b865b88b1d for instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 on hv-cinder-81566 Oct 27 14:09:03.833297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-ab05bda7-29da-439a-a581-ae12ab1da59b req-834a1f76-b01e-445f-a433-5e1212fe303c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055224 Oct 27 14:09:03.834694 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 77/152] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:03.968942 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7ff47ee4-9395-463b-8e92-dd37cb9ca098 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:03.970209 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7ff47ee4-9395-463b-8e92-dd37cb9ca098 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:03.974040 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-773beda9-7048-4a2c-a736-ade84cdde06f req-8adfd2c3-e169-4fe5-8fda-a12cca44cf2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396ab30c-d8d7-48b2-a476-fe2cd2d21ce8", "tag": "15887899-2093-4823-88fd-9157f73d58e7"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:03.976404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:03.976404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:09:03.978154 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7ff47ee4-9395-463b-8e92-dd37cb9ca098 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:03.978750 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7ff47ee4-9395-463b-8e92-dd37cb9ca098 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:03.979734 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7ff47ee4-9395-463b-8e92-dd37cb9ca098 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:03.980302 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7ff47ee4-9395-463b-8e92-dd37cb9ca098 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:03.987050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-773beda9-7048-4a2c-a736-ade84cdde06f req-8adfd2c3-e169-4fe5-8fda-a12cca44cf2f service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:03.989384 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-773beda9-7048-4a2c-a736-ade84cdde06f req-8adfd2c3-e169-4fe5-8fda-a12cca44cf2f service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:04.004275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-773beda9-7048-4a2c-a736-ade84cdde06f req-8adfd2c3-e169-4fe5-8fda-a12cca44cf2f service nova] Creating event network-changed:15887899-2093-4823-88fd-9157f73d58e7 for instance 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 on hv-cinder-81566 Oct 27 14:09:04.010935 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-773beda9-7048-4a2c-a736-ade84cdde06f req-8adfd2c3-e169-4fe5-8fda-a12cca44cf2f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041459 Oct 27 14:09:04.011737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 78/153] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:04.204935 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5b3ad7d7-5843-4de7-ad50-da8b75473b24 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:04.205869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5b3ad7d7-5843-4de7-ad50-da8b75473b24 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:04.212261 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b3ad7d7-5843-4de7-ad50-da8b75473b24 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:04.213170 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b3ad7d7-5843-4de7-ad50-da8b75473b24 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:04.213962 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b3ad7d7-5843-4de7-ad50-da8b75473b24 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:04.214398 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b3ad7d7-5843-4de7-ad50-da8b75473b24 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:04.345223 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5b3ad7d7-5843-4de7-ad50-da8b75473b24 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:04.353224 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5b3ad7d7-5843-4de7-ad50-da8b75473b24 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.153360 Oct 27 14:09:04.353797 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 79/154] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:04 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:04.680175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5c4909df-a34e-4d41-836a-38a7bc108737 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:04.680768 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5c4909df-a34e-4d41-836a-38a7bc108737 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:04.686560 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c4909df-a34e-4d41-836a-38a7bc108737 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:04.687000 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c4909df-a34e-4d41-836a-38a7bc108737 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:04.687792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c4909df-a34e-4d41-836a-38a7bc108737 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:04.688214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c4909df-a34e-4d41-836a-38a7bc108737 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:04.816114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5c4909df-a34e-4d41-836a-38a7bc108737 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:04.824316 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5c4909df-a34e-4d41-836a-38a7bc108737 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:04.825903 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5c4909df-a34e-4d41-836a-38a7bc108737 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:04.827120 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5c4909df-a34e-4d41-836a-38a7bc108737 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.150642 Oct 27 14:09:04.827777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 80/155] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:09:04 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:09:05.370468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1be29af8-4c71-486d-950f-88fcb53f2063 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:05.371153 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1be29af8-4c71-486d-950f-88fcb53f2063 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:05.377652 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1be29af8-4c71-486d-950f-88fcb53f2063 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:05.378098 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1be29af8-4c71-486d-950f-88fcb53f2063 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:05.378894 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1be29af8-4c71-486d-950f-88fcb53f2063 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:05.379369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1be29af8-4c71-486d-950f-88fcb53f2063 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:05.503031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1be29af8-4c71-486d-950f-88fcb53f2063 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:05.511219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1be29af8-4c71-486d-950f-88fcb53f2063 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.144279 Oct 27 14:09:05.511931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 81/156] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:05 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:05.845672 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0a9d7cc9-a2b3-4ed3-8a3f-1e79196e26fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:05.846263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0a9d7cc9-a2b3-4ed3-8a3f-1e79196e26fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:05.852317 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0a9d7cc9-a2b3-4ed3-8a3f-1e79196e26fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:05.852765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0a9d7cc9-a2b3-4ed3-8a3f-1e79196e26fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:05.853530 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0a9d7cc9-a2b3-4ed3-8a3f-1e79196e26fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:05.853958 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0a9d7cc9-a2b3-4ed3-8a3f-1e79196e26fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:05.980695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0a9d7cc9-a2b3-4ed3-8a3f-1e79196e26fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:05.988380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0a9d7cc9-a2b3-4ed3-8a3f-1e79196e26fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:05.989917 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0a9d7cc9-a2b3-4ed3-8a3f-1e79196e26fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:05.991741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0a9d7cc9-a2b3-4ed3-8a3f-1e79196e26fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.149096 Oct 27 14:09:05.992584 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 82/157] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:09:05 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:09:06.529448 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-077c6989-33eb-4c83-9810-b9833ed20f51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:06.530125 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-077c6989-33eb-4c83-9810-b9833ed20f51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:06.541696 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077c6989-33eb-4c83-9810-b9833ed20f51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:06.542263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077c6989-33eb-4c83-9810-b9833ed20f51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:06.543110 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077c6989-33eb-4c83-9810-b9833ed20f51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:06.543594 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077c6989-33eb-4c83-9810-b9833ed20f51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:06.591499 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7ff47ee4-9395-463b-8e92-dd37cb9ca098 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 2.625734 Oct 27 14:09:06.593228 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 76/158] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:03 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:06.769382 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-077c6989-33eb-4c83-9810-b9833ed20f51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:06.778009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-077c6989-33eb-4c83-9810-b9833ed20f51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.251821 Oct 27 14:09:06.778784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 83/159] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:06 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:07.010933 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c0209b70-8a5e-4293-9be4-9f11aa8cc409 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:07.011760 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c0209b70-8a5e-4293-9be4-9f11aa8cc409 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:07.018548 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c0209b70-8a5e-4293-9be4-9f11aa8cc409 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:07.018988 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c0209b70-8a5e-4293-9be4-9f11aa8cc409 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:07.019781 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c0209b70-8a5e-4293-9be4-9f11aa8cc409 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:07.020205 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c0209b70-8a5e-4293-9be4-9f11aa8cc409 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:07.145354 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c0209b70-8a5e-4293-9be4-9f11aa8cc409 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:07.153899 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c0209b70-8a5e-4293-9be4-9f11aa8cc409 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:07.155447 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c0209b70-8a5e-4293-9be4-9f11aa8cc409 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:07.156549 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c0209b70-8a5e-4293-9be4-9f11aa8cc409 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.150335 Oct 27 14:09:07.157102 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 77/160] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:09:07 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:09:07.603080 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-061feca2-30bb-4005-8b3b-5e5b1bc08a91 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:07.604068 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-061feca2-30bb-4005-8b3b-5e5b1bc08a91 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:07.610629 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-061feca2-30bb-4005-8b3b-5e5b1bc08a91 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:07.611429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-061feca2-30bb-4005-8b3b-5e5b1bc08a91 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:07.612215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-061feca2-30bb-4005-8b3b-5e5b1bc08a91 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:07.612654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-061feca2-30bb-4005-8b3b-5e5b1bc08a91 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:07.740730 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-061feca2-30bb-4005-8b3b-5e5b1bc08a91 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.141739 Oct 27 14:09:07.741993 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 84/161] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:07 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:07.796185 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-bcfdfbc9-dc01-4576-ae91-b1ae86a2860a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:07.796850 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-bcfdfbc9-dc01-4576-ae91-b1ae86a2860a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:07.803253 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bcfdfbc9-dc01-4576-ae91-b1ae86a2860a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:07.804583 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bcfdfbc9-dc01-4576-ae91-b1ae86a2860a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:07.805565 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bcfdfbc9-dc01-4576-ae91-b1ae86a2860a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:07.806166 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bcfdfbc9-dc01-4576-ae91-b1ae86a2860a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:07.963556 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-bcfdfbc9-dc01-4576-ae91-b1ae86a2860a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:07.974155 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-bcfdfbc9-dc01-4576-ae91-b1ae86a2860a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.180398 Oct 27 14:09:07.974155 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 78/162] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:07 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:08.175159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a74d569b-769b-452d-b8e2-645874f3d305 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:08.175839 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a74d569b-769b-452d-b8e2-645874f3d305 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:08.183800 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74d569b-769b-452d-b8e2-645874f3d305 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:08.193023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74d569b-769b-452d-b8e2-645874f3d305 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:08.193023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74d569b-769b-452d-b8e2-645874f3d305 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:08.193023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74d569b-769b-452d-b8e2-645874f3d305 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:08.357714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a74d569b-769b-452d-b8e2-645874f3d305 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:08.376248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a74d569b-769b-452d-b8e2-645874f3d305 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:08.378265 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a74d569b-769b-452d-b8e2-645874f3d305 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:08.379439 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a74d569b-769b-452d-b8e2-645874f3d305 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1407 microversion: 2.20 time: 0.208275 Oct 27 14:09:08.380331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 85/163] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:09:08 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:09:08.752951 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-17c565ae-e98a-4c70-a984-c6fa1bfdf44c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:08.753950 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-17c565ae-e98a-4c70-a984-c6fa1bfdf44c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:08.760545 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17c565ae-e98a-4c70-a984-c6fa1bfdf44c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:08.760990 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17c565ae-e98a-4c70-a984-c6fa1bfdf44c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:08.761790 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17c565ae-e98a-4c70-a984-c6fa1bfdf44c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:08.762223 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17c565ae-e98a-4c70-a984-c6fa1bfdf44c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:08.862307 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-17c565ae-e98a-4c70-a984-c6fa1bfdf44c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.113222 Oct 27 14:09:08.862976 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 79/164] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:08 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:08.989886 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d06addd1-67ab-4e6c-bf20-7614e2a4c6da tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:08.990502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d06addd1-67ab-4e6c-bf20-7614e2a4c6da tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:08.996743 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d06addd1-67ab-4e6c-bf20-7614e2a4c6da tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:08.997182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d06addd1-67ab-4e6c-bf20-7614e2a4c6da tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:08.997969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d06addd1-67ab-4e6c-bf20-7614e2a4c6da tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:08.998397 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d06addd1-67ab-4e6c-bf20-7614e2a4c6da tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:09.146407 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d06addd1-67ab-4e6c-bf20-7614e2a4c6da tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:09.167636 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d06addd1-67ab-4e6c-bf20-7614e2a4c6da tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.181310 Oct 27 14:09:09.168588 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 86/165] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:08 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:09.374990 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-613741539", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "networks": [{"uuid": "5b53c648-0313-4179-8334-9fa5d1933987"}]}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:09.398965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f228637b-0878-4185-acda-b484970d9f7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:09.399170 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f228637b-0878-4185-acda-b484970d9f7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:09.409880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f228637b-0878-4185-acda-b484970d9f7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:09.410416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f228637b-0878-4185-acda-b484970d9f7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:09.411249 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f228637b-0878-4185-acda-b484970d9f7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:09.411751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f228637b-0878-4185-acda-b484970d9f7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:09.449859 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.network.neutron [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] validate_networks() for [('5b53c648-0313-4179-8334-9fa5d1933987', None, None, None, None, None)] {{(pid=115932) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:09:09.639039 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f228637b-0878-4185-acda-b484970d9f7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:09.647631 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f228637b-0878-4185-acda-b484970d9f7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:09.649133 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f228637b-0878-4185-acda-b484970d9f7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:09.650849 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f228637b-0878-4185-acda-b484970d9f7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1600 microversion: 2.20 time: 0.256821 Oct 27 14:09:09.651728 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 87/166] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:09:09 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1600 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:09:09.679774 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dd344ed5-2539-4b78-b428-0625f0cfe071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:09.680416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dd344ed5-2539-4b78-b428-0625f0cfe071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:09.687266 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd344ed5-2539-4b78-b428-0625f0cfe071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:09.687735 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd344ed5-2539-4b78-b428-0625f0cfe071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:09.688539 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd344ed5-2539-4b78-b428-0625f0cfe071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:09.690387 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd344ed5-2539-4b78-b428-0625f0cfe071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:09.884626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dd344ed5-2539-4b78-b428-0625f0cfe071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.217498 Oct 27 14:09:09.891113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 88/167] 10.222.0.85 () {60 vars in 1315 bytes} [Wed Oct 27 14:09:09 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:09:09.903903 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7d189858-0942-473a-be8f-fb00a3bf78fa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:09.905030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7d189858-0942-473a-be8f-fb00a3bf78fa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:09.916307 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7d189858-0942-473a-be8f-fb00a3bf78fa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:09.916969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7d189858-0942-473a-be8f-fb00a3bf78fa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:09.917758 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7d189858-0942-473a-be8f-fb00a3bf78fa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:09.918911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7d189858-0942-473a-be8f-fb00a3bf78fa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:10.029118 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7d189858-0942-473a-be8f-fb00a3bf78fa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.136107 Oct 27 14:09:10.029796 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 89/168] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:09 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:10.185741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dd729410-39ef-4c0a-89a9-b5134c6b2102 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:10.186437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dd729410-39ef-4c0a-89a9-b5134c6b2102 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:10.193721 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd729410-39ef-4c0a-89a9-b5134c6b2102 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:10.194180 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd729410-39ef-4c0a-89a9-b5134c6b2102 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:10.194942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd729410-39ef-4c0a-89a9-b5134c6b2102 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:10.195405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd729410-39ef-4c0a-89a9-b5134c6b2102 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:10.335729 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Flavor limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:09:10.337610 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Image limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:09:10.338665 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Flavor pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:09:10.339077 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Image pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:09:10.340497 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:09:10.352465 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:10.353710 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:10.354758 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:10.355210 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:10.375235 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Getting quotas for project a55431e3db544b7980c81c6303d1e8b2. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:09:10.380458 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Getting quotas for user 3e59b470cb41474bb92d7e1049d02e6f and project a55431e3db544b7980c81c6303d1e8b2. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:09:10.395070 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Going to run 1 instances... {{(pid=115932) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:09:10.398308 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:09:10.459328 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-00f68eca-a353-4bae-a3a1-15e8bd54e9ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.088162 Oct 27 14:09:10.460827 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 80/169] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:09:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:09:10.471425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ee5aebb4-7d85-4790-8270-7ee26fbec51c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:10.472336 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ee5aebb4-7d85-4790-8270-7ee26fbec51c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:10.813552 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ee5aebb4-7d85-4790-8270-7ee26fbec51c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:10.829328 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ee5aebb4-7d85-4790-8270-7ee26fbec51c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1217 microversion: 2.1 time: 0.361928 Oct 27 14:09:10.838920 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 81/170] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:10 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1217 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:10.843915 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-dd729410-39ef-4c0a-89a9-b5134c6b2102 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:10.855159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dd729410-39ef-4c0a-89a9-b5134c6b2102 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.673963 Oct 27 14:09:10.855765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 90/171] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:10 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:11.043049 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-35fb65b9-4ede-48fe-9db0-20b089e2d11d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:11.044102 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-35fb65b9-4ede-48fe-9db0-20b089e2d11d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:11.054109 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35fb65b9-4ede-48fe-9db0-20b089e2d11d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:11.054561 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35fb65b9-4ede-48fe-9db0-20b089e2d11d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:11.055385 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35fb65b9-4ede-48fe-9db0-20b089e2d11d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:11.055865 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35fb65b9-4ede-48fe-9db0-20b089e2d11d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:11.182507 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-35fb65b9-4ede-48fe-9db0-20b089e2d11d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.145610 Oct 27 14:09:11.183608 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 82/172] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:11 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:11.848011 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-790afb10-af59-4748-a834-20e57eb49269 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:11.849198 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-790afb10-af59-4748-a834-20e57eb49269 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:11.855925 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-790afb10-af59-4748-a834-20e57eb49269 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:11.856595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-790afb10-af59-4748-a834-20e57eb49269 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:11.857534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-790afb10-af59-4748-a834-20e57eb49269 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:11.858396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-790afb10-af59-4748-a834-20e57eb49269 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:11.880623 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-436f2ffa-f767-4597-bc46-878ed7043c6c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:11.882641 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-436f2ffa-f767-4597-bc46-878ed7043c6c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:11.903452 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-436f2ffa-f767-4597-bc46-878ed7043c6c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:11.904463 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-436f2ffa-f767-4597-bc46-878ed7043c6c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:11.905932 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-436f2ffa-f767-4597-bc46-878ed7043c6c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:11.909895 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-436f2ffa-f767-4597-bc46-878ed7043c6c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:12.027856 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-790afb10-af59-4748-a834-20e57eb49269 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:12.036307 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-790afb10-af59-4748-a834-20e57eb49269 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1277 microversion: 2.1 time: 0.194338 Oct 27 14:09:12.036847 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 91/173] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:11 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:12.178520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b6f21fc9-a920-4aa6-b632-f8d2ca1d5271 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:12.179476 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b6f21fc9-a920-4aa6-b632-f8d2ca1d5271 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:12.187959 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b6f21fc9-a920-4aa6-b632-f8d2ca1d5271 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:12.190718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b6f21fc9-a920-4aa6-b632-f8d2ca1d5271 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:12.192390 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b6f21fc9-a920-4aa6-b632-f8d2ca1d5271 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:12.195006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b6f21fc9-a920-4aa6-b632-f8d2ca1d5271 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:12.344266 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b6f21fc9-a920-4aa6-b632-f8d2ca1d5271 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.168737 Oct 27 14:09:12.345741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 92/174] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:12 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:12.354457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0e03f69e-c642-425f-99d6-ba88751483be tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:12.361499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0e03f69e-c642-425f-99d6-ba88751483be tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:12.397067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e03f69e-c642-425f-99d6-ba88751483be tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:12.400301 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e03f69e-c642-425f-99d6-ba88751483be tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:12.404395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e03f69e-c642-425f-99d6-ba88751483be tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:12.405314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e03f69e-c642-425f-99d6-ba88751483be tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:12.532658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0e03f69e-c642-425f-99d6-ba88751483be tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.184366 Oct 27 14:09:12.533819 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 93/175] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:12 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:12.540143 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-66e25c51-a258-4278-ba37-dd765fa53478 req-de09d177-8029-457f-a471-5fcb95286145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e12ebd-fe44-4aa9-8f5e-572d91370319", "tag": "aab79689-5599-45f7-b77c-95b865b88b1d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:12.542185 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:12.542185 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:09:12.559418 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-436f2ffa-f767-4597-bc46-878ed7043c6c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:12.565140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-66e25c51-a258-4278-ba37-dd765fa53478 req-de09d177-8029-457f-a471-5fcb95286145 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:12.565863 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-66e25c51-a258-4278-ba37-dd765fa53478 req-de09d177-8029-457f-a471-5fcb95286145 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:12.567910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-436f2ffa-f767-4597-bc46-878ed7043c6c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.696626 Oct 27 14:09:12.570951 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 83/176] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:11 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:12.601824 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-66e25c51-a258-4278-ba37-dd765fa53478 req-de09d177-8029-457f-a471-5fcb95286145 service nova] Creating event network-changed:aab79689-5599-45f7-b77c-95b865b88b1d for instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 on hv-cinder-81566 Oct 27 14:09:12.620710 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-66e25c51-a258-4278-ba37-dd765fa53478 req-de09d177-8029-457f-a471-5fcb95286145 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085227 Oct 27 14:09:12.621665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 94/177] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:13.064134 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e9ea0826-fa49-4f2b-8288-426410ea8c6a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:13.064960 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e9ea0826-fa49-4f2b-8288-426410ea8c6a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:13.080685 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e9ea0826-fa49-4f2b-8288-426410ea8c6a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:13.081568 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e9ea0826-fa49-4f2b-8288-426410ea8c6a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:13.085429 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e9ea0826-fa49-4f2b-8288-426410ea8c6a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:13.085965 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e9ea0826-fa49-4f2b-8288-426410ea8c6a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:13.200218 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e9ea0826-fa49-4f2b-8288-426410ea8c6a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:13.210874 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e9ea0826-fa49-4f2b-8288-426410ea8c6a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1275 microversion: 2.1 time: 0.160394 Oct 27 14:09:13.213180 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 84/178] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:13 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:13.357049 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2c14fc77-880e-49a4-a004-5343b96bab6d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:13.358891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2c14fc77-880e-49a4-a004-5343b96bab6d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:13.371101 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2c14fc77-880e-49a4-a004-5343b96bab6d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:13.371582 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2c14fc77-880e-49a4-a004-5343b96bab6d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:13.372380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2c14fc77-880e-49a4-a004-5343b96bab6d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:13.372809 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2c14fc77-880e-49a4-a004-5343b96bab6d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:13.529276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2c14fc77-880e-49a4-a004-5343b96bab6d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.175622 Oct 27 14:09:13.529983 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 95/179] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:13 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:13.545561 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4b216414-e71b-420f-94a7-b971cf187c57 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:13.546333 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4b216414-e71b-420f-94a7-b971cf187c57 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:13.567988 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4b216414-e71b-420f-94a7-b971cf187c57 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:13.568443 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4b216414-e71b-420f-94a7-b971cf187c57 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:13.571206 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4b216414-e71b-420f-94a7-b971cf187c57 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:13.573972 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4b216414-e71b-420f-94a7-b971cf187c57 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:13.587042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d866a6f3-ce8c-456a-9baa-cf2b643896d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:13.588891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d866a6f3-ce8c-456a-9baa-cf2b643896d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:13.601370 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d866a6f3-ce8c-456a-9baa-cf2b643896d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:13.603217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d866a6f3-ce8c-456a-9baa-cf2b643896d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:13.605448 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d866a6f3-ce8c-456a-9baa-cf2b643896d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:13.607452 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d866a6f3-ce8c-456a-9baa-cf2b643896d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:13.717968 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4b216414-e71b-420f-94a7-b971cf187c57 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.177598 Oct 27 14:09:13.719198 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 85/180] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:13 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:14.233607 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-671f2ecf-08e9-4e1c-8807-55d7b5344846 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:14.234343 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-671f2ecf-08e9-4e1c-8807-55d7b5344846 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:14.253342 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-671f2ecf-08e9-4e1c-8807-55d7b5344846 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:14.254254 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-671f2ecf-08e9-4e1c-8807-55d7b5344846 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:14.255847 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-671f2ecf-08e9-4e1c-8807-55d7b5344846 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:14.257004 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-671f2ecf-08e9-4e1c-8807-55d7b5344846 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:14.447928 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d866a6f3-ce8c-456a-9baa-cf2b643896d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:14.459558 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d866a6f3-ce8c-456a-9baa-cf2b643896d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.876858 Oct 27 14:09:14.470027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 96/181] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:13 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:14.542329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-05f72c6f-e0db-4348-b278-41e940923931 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:14.543290 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-05f72c6f-e0db-4348-b278-41e940923931 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:14.562615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-05f72c6f-e0db-4348-b278-41e940923931 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:14.562615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-05f72c6f-e0db-4348-b278-41e940923931 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:14.562615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-05f72c6f-e0db-4348-b278-41e940923931 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:14.562615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-05f72c6f-e0db-4348-b278-41e940923931 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:14.688665 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-671f2ecf-08e9-4e1c-8807-55d7b5344846 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:14.696266 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-671f2ecf-08e9-4e1c-8807-55d7b5344846 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1317 microversion: 2.1 time: 0.470322 Oct 27 14:09:14.700380 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 86/182] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:14 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:14.712656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-05f72c6f-e0db-4348-b278-41e940923931 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.174749 Oct 27 14:09:14.713393 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 97/183] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:14 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:14.732721 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7546a874-f1d0-4d61-a249-c4ea551e2191 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:14.733641 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7546a874-f1d0-4d61-a249-c4ea551e2191 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:14.740022 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7546a874-f1d0-4d61-a249-c4ea551e2191 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:14.740711 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7546a874-f1d0-4d61-a249-c4ea551e2191 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:14.741667 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7546a874-f1d0-4d61-a249-c4ea551e2191 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:14.742101 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7546a874-f1d0-4d61-a249-c4ea551e2191 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:14.829000 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7546a874-f1d0-4d61-a249-c4ea551e2191 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.103087 Oct 27 14:09:14.829954 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 87/184] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:14 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:15.161990 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-ba26ccdc-481d-4fdb-8f55-536a9f71d255 req-d36d8037-cb59-43c3-931f-d8003e00bfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b67be3cc-1fc7-4fc3-bdd0-03c799491784", "tag": "9b8b3480-396e-4f51-94d1-f326ad7aef3e"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:15.176153 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:15.176153 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:09:15.199006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-ba26ccdc-481d-4fdb-8f55-536a9f71d255 req-d36d8037-cb59-43c3-931f-d8003e00bfb3 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:15.205641 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-ba26ccdc-481d-4fdb-8f55-536a9f71d255 req-d36d8037-cb59-43c3-931f-d8003e00bfb3 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:15.235802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-ba26ccdc-481d-4fdb-8f55-536a9f71d255 req-d36d8037-cb59-43c3-931f-d8003e00bfb3 service nova] Creating event network-changed:9b8b3480-396e-4f51-94d1-f326ad7aef3e for instance b67be3cc-1fc7-4fc3-bdd0-03c799491784 on hv-cinder-81566 Oct 27 14:09:15.259741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-ba26ccdc-481d-4fdb-8f55-536a9f71d255 req-d36d8037-cb59-43c3-931f-d8003e00bfb3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101629 Oct 27 14:09:15.267747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 98/185] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:15.478192 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b0c71c12-cba4-4a77-ae3d-f789ff5ab154 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:15.479213 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-b0c71c12-cba4-4a77-ae3d-f789ff5ab154 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:15.486748 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b0c71c12-cba4-4a77-ae3d-f789ff5ab154 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:15.487109 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b0c71c12-cba4-4a77-ae3d-f789ff5ab154 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:15.487953 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b0c71c12-cba4-4a77-ae3d-f789ff5ab154 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:15.488359 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b0c71c12-cba4-4a77-ae3d-f789ff5ab154 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:15.689977 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-b0c71c12-cba4-4a77-ae3d-f789ff5ab154 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:15.701858 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b0c71c12-cba4-4a77-ae3d-f789ff5ab154 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.227721 Oct 27 14:09:15.703823 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 88/186] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:15 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:15.721755 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-292c8ea7-9a82-41dc-abd7-60d3ab9f5f1b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:15.722432 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-292c8ea7-9a82-41dc-abd7-60d3ab9f5f1b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:15.724353 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f8613453-40b2-46ab-ab5f-95c9378ebd58 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:15.725270 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f8613453-40b2-46ab-ab5f-95c9378ebd58 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:15.728941 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-292c8ea7-9a82-41dc-abd7-60d3ab9f5f1b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:15.729390 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-292c8ea7-9a82-41dc-abd7-60d3ab9f5f1b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:15.730165 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-292c8ea7-9a82-41dc-abd7-60d3ab9f5f1b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:15.730591 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-292c8ea7-9a82-41dc-abd7-60d3ab9f5f1b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:15.731103 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8613453-40b2-46ab-ab5f-95c9378ebd58 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:15.732803 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8613453-40b2-46ab-ab5f-95c9378ebd58 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:15.733589 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8613453-40b2-46ab-ab5f-95c9378ebd58 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:15.734651 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8613453-40b2-46ab-ab5f-95c9378ebd58 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:15.859325 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f8613453-40b2-46ab-ab5f-95c9378ebd58 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.138483 Oct 27 14:09:15.860238 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 89/187] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:15 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:15.865382 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1c17fb45-ac6d-4e67-bb33-ca869d78413a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:15.866511 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1c17fb45-ac6d-4e67-bb33-ca869d78413a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:15.873644 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c17fb45-ac6d-4e67-bb33-ca869d78413a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:15.874231 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c17fb45-ac6d-4e67-bb33-ca869d78413a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:15.875107 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c17fb45-ac6d-4e67-bb33-ca869d78413a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:15.876118 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c17fb45-ac6d-4e67-bb33-ca869d78413a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:15.953695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-292c8ea7-9a82-41dc-abd7-60d3ab9f5f1b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:15.957617 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1c17fb45-ac6d-4e67-bb33-ca869d78413a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.095964 Oct 27 14:09:15.960873 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 90/188] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:15 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:15.961517 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-292c8ea7-9a82-41dc-abd7-60d3ab9f5f1b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1317 microversion: 2.1 time: 0.245956 Oct 27 14:09:15.963114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 99/189] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:15 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:16.337363 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1214032416", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "networks": [{"uuid": "c0995375-e054-40e9-8e71-5bfdb80f49d9"}]}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:16.405035 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.network.neutron [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] validate_networks() for [('c0995375-e054-40e9-8e71-5bfdb80f49d9', None, None, None, None, None)] {{(pid=115932) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:09:16.425476 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e16286c5-0188-41b5-9695-96dc6873a8af tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:16.427063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e16286c5-0188-41b5-9695-96dc6873a8af tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:16.434889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e16286c5-0188-41b5-9695-96dc6873a8af tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:16.435456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e16286c5-0188-41b5-9695-96dc6873a8af tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:16.436310 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e16286c5-0188-41b5-9695-96dc6873a8af tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:16.437872 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e16286c5-0188-41b5-9695-96dc6873a8af tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:16.466543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e16286c5-0188-41b5-9695-96dc6873a8af tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:09:16.575908 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e16286c5-0188-41b5-9695-96dc6873a8af tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 204 len: 0 microversion: 2.1 time: 0.154855 Oct 27 14:09:16.576932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 100/190] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:09:16 2021] DELETE /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:09:16.585109 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6213239f-4d80-4ce5-80f1-a930ecb5ceaf tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:16.586056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6213239f-4d80-4ce5-80f1-a930ecb5ceaf tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:16.592114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6213239f-4d80-4ce5-80f1-a930ecb5ceaf tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:16.592552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6213239f-4d80-4ce5-80f1-a930ecb5ceaf tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:16.593315 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6213239f-4d80-4ce5-80f1-a930ecb5ceaf tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:16.593737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6213239f-4d80-4ce5-80f1-a930ecb5ceaf tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:16.833046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6213239f-4d80-4ce5-80f1-a930ecb5ceaf tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:16.841631 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6213239f-4d80-4ce5-80f1-a930ecb5ceaf tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1552 microversion: 2.1 time: 0.260314 Oct 27 14:09:16.842581 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 101/191] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:16 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1552 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:16.847010 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b60e093c-9490-450f-8d4f-2f81be2f9373 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:16.847656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b60e093c-9490-450f-8d4f-2f81be2f9373 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:16.853382 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b60e093c-9490-450f-8d4f-2f81be2f9373 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:16.854157 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b60e093c-9490-450f-8d4f-2f81be2f9373 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:16.854944 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b60e093c-9490-450f-8d4f-2f81be2f9373 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:16.855409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b60e093c-9490-450f-8d4f-2f81be2f9373 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:16.906908 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Flavor limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:09:16.907439 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Image limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:09:16.907887 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Flavor pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:09:16.908293 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Image pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:09:16.908713 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:09:16.919534 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:16.919988 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:16.920793 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:16.921395 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:16.941267 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Getting quotas for project e557227f6d404acba108444e2f807bc2. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:09:16.945886 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Getting quotas for user 003eebaf9aa14c90ade79784224c49a4 and project e557227f6d404acba108444e2f807bc2. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:09:16.963070 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Going to run 1 instances... {{(pid=115932) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:09:16.966718 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:09:16.999643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b60e093c-9490-450f-8d4f-2f81be2f9373 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:17.011076 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b60e093c-9490-450f-8d4f-2f81be2f9373 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.167259 Oct 27 14:09:17.011713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 102/192] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:16 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:17.016965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0ef270a3-cc4c-4ed9-b9db-9f2ab9c966d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:17.018002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0ef270a3-cc4c-4ed9-b9db-9f2ab9c966d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:17.024739 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d4a4d670-cd37-4ffb-9e54-609262ade303 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691337 Oct 27 14:09:17.024883 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ef270a3-cc4c-4ed9-b9db-9f2ab9c966d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:17.025673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ef270a3-cc4c-4ed9-b9db-9f2ab9c966d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:17.026869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ef270a3-cc4c-4ed9-b9db-9f2ab9c966d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:17.027736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ef270a3-cc4c-4ed9-b9db-9f2ab9c966d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:17.035023 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 91/193] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:09:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:09:17.041512 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8d4727e9-2c2a-43fc-b9b5-b7ebbe58e256 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:17.042513 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-8d4727e9-2c2a-43fc-b9b5-b7ebbe58e256 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:17.053387 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8d4727e9-2c2a-43fc-b9b5-b7ebbe58e256 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:17.053911 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8d4727e9-2c2a-43fc-b9b5-b7ebbe58e256 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:17.055274 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8d4727e9-2c2a-43fc-b9b5-b7ebbe58e256 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:17.058619 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8d4727e9-2c2a-43fc-b9b5-b7ebbe58e256 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:17.170577 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0ef270a3-cc4c-4ed9-b9db-9f2ab9c966d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.157033 Oct 27 14:09:17.174081 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 103/194] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:17 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:17.177197 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-34792cb3-2e7b-4552-bdc2-7890bc6828a8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:17.177900 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-34792cb3-2e7b-4552-bdc2-7890bc6828a8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:17.185830 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34792cb3-2e7b-4552-bdc2-7890bc6828a8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:17.186289 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34792cb3-2e7b-4552-bdc2-7890bc6828a8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:17.187311 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34792cb3-2e7b-4552-bdc2-7890bc6828a8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:17.187887 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34792cb3-2e7b-4552-bdc2-7890bc6828a8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:17.188786 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-8d4727e9-2c2a-43fc-b9b5-b7ebbe58e256 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.151503 Oct 27 14:09:17.189837 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 92/195] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:17 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:17.195598 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a7bf86a1-1cef-4a8a-be32-4cfb02436b20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:17.197095 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a7bf86a1-1cef-4a8a-be32-4cfb02436b20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:17.262226 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a7bf86a1-1cef-4a8a-be32-4cfb02436b20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:17.269648 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a7bf86a1-1cef-4a8a-be32-4cfb02436b20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1219 microversion: 2.1 time: 0.078135 Oct 27 14:09:17.270642 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 93/196] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:17 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:17.365184 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-34792cb3-2e7b-4552-bdc2-7890bc6828a8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:17.373741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-34792cb3-2e7b-4552-bdc2-7890bc6828a8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1317 microversion: 2.1 time: 0.200644 Oct 27 14:09:17.374370 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 104/197] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:17 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:17.858121 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-00f8e6c3-af96-46de-9410-64f99d8cb4bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:17.858835 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-00f8e6c3-af96-46de-9410-64f99d8cb4bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:17.865992 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-00f8e6c3-af96-46de-9410-64f99d8cb4bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:17.866527 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-00f8e6c3-af96-46de-9410-64f99d8cb4bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:17.867419 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-00f8e6c3-af96-46de-9410-64f99d8cb4bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:17.867908 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-00f8e6c3-af96-46de-9410-64f99d8cb4bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:17.992107 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-00f8e6c3-af96-46de-9410-64f99d8cb4bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:18.000708 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-00f8e6c3-af96-46de-9410-64f99d8cb4bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1552 microversion: 2.1 time: 0.146389 Oct 27 14:09:18.001530 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 94/198] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:17 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:18.027700 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9835d175-11e4-4dbc-88ed-7d6bfba22506 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:18.028315 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9835d175-11e4-4dbc-88ed-7d6bfba22506 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:18.035061 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9835d175-11e4-4dbc-88ed-7d6bfba22506 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:18.035520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9835d175-11e4-4dbc-88ed-7d6bfba22506 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:18.036288 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9835d175-11e4-4dbc-88ed-7d6bfba22506 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:18.036707 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9835d175-11e4-4dbc-88ed-7d6bfba22506 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:18.159693 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9835d175-11e4-4dbc-88ed-7d6bfba22506 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:18.167448 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9835d175-11e4-4dbc-88ed-7d6bfba22506 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.143688 Oct 27 14:09:18.168013 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 105/199] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:18 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:18.182600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-fb45e304-7f47-4b81-8aa8-fbc350b74a98 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:18.183535 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-fb45e304-7f47-4b81-8aa8-fbc350b74a98 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:18.189883 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fb45e304-7f47-4b81-8aa8-fbc350b74a98 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:18.190332 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fb45e304-7f47-4b81-8aa8-fbc350b74a98 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:18.191098 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fb45e304-7f47-4b81-8aa8-fbc350b74a98 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:18.191590 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fb45e304-7f47-4b81-8aa8-fbc350b74a98 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:18.200165 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3017c880-5f69-4e4a-b702-296a29ce43c8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:18.201050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3017c880-5f69-4e4a-b702-296a29ce43c8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:18.206792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3017c880-5f69-4e4a-b702-296a29ce43c8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:18.207269 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3017c880-5f69-4e4a-b702-296a29ce43c8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:18.208037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3017c880-5f69-4e4a-b702-296a29ce43c8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:18.208467 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3017c880-5f69-4e4a-b702-296a29ce43c8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:18.303287 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-fb45e304-7f47-4b81-8aa8-fbc350b74a98 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.124650 Oct 27 14:09:18.304090 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 95/200] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:18 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:18.310726 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-045f58c2-fd10-4328-9cd7-4ee3d463bfc8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:18.311449 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-045f58c2-fd10-4328-9cd7-4ee3d463bfc8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:18.319729 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-045f58c2-fd10-4328-9cd7-4ee3d463bfc8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:18.320259 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-045f58c2-fd10-4328-9cd7-4ee3d463bfc8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:18.321014 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3017c880-5f69-4e4a-b702-296a29ce43c8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.124725 Oct 27 14:09:18.321161 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-045f58c2-fd10-4328-9cd7-4ee3d463bfc8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:18.322138 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-045f58c2-fd10-4328-9cd7-4ee3d463bfc8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:18.325446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 106/201] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:18 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 14:09:18.392561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-41d48ad0-6cf3-4b71-bd46-a6a18176347e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:18.393250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-41d48ad0-6cf3-4b71-bd46-a6a18176347e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:18.403635 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41d48ad0-6cf3-4b71-bd46-a6a18176347e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:18.404171 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41d48ad0-6cf3-4b71-bd46-a6a18176347e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:18.405053 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41d48ad0-6cf3-4b71-bd46-a6a18176347e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:18.405487 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41d48ad0-6cf3-4b71-bd46-a6a18176347e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:18.447533 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-045f58c2-fd10-4328-9cd7-4ee3d463bfc8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:18.464940 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-045f58c2-fd10-4328-9cd7-4ee3d463bfc8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1279 microversion: 2.1 time: 0.159169 Oct 27 14:09:18.465620 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 96/202] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:18 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:18.601750 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-41d48ad0-6cf3-4b71-bd46-a6a18176347e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:18.609609 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-41d48ad0-6cf3-4b71-bd46-a6a18176347e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1317 microversion: 2.1 time: 0.220984 Oct 27 14:09:18.610275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 107/203] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:18 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:19.017776 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-04ce9ec1-85ee-441b-9961-afcc3a038352 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:19.018370 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-04ce9ec1-85ee-441b-9961-afcc3a038352 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:19.024736 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-04ce9ec1-85ee-441b-9961-afcc3a038352 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.025185 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-04ce9ec1-85ee-441b-9961-afcc3a038352 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.025972 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-04ce9ec1-85ee-441b-9961-afcc3a038352 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.026807 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-04ce9ec1-85ee-441b-9961-afcc3a038352 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.183837 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-daa4fdd0-173f-4624-98c2-4acb1f17d234 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:19.184452 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-daa4fdd0-173f-4624-98c2-4acb1f17d234 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:19.190672 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-daa4fdd0-173f-4624-98c2-4acb1f17d234 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.191172 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-daa4fdd0-173f-4624-98c2-4acb1f17d234 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.191950 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-daa4fdd0-173f-4624-98c2-4acb1f17d234 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.192378 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-daa4fdd0-173f-4624-98c2-4acb1f17d234 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.250509 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-04ce9ec1-85ee-441b-9961-afcc3a038352 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:19.260460 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-04ce9ec1-85ee-441b-9961-afcc3a038352 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1552 microversion: 2.1 time: 0.246111 Oct 27 14:09:19.261248 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 97/204] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:19 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1552 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:19.316299 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ec1f3570-38f4-4b35-9ed8-3299ac87da01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:19.317228 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ec1f3570-38f4-4b35-9ed8-3299ac87da01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:19.324559 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec1f3570-38f4-4b35-9ed8-3299ac87da01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.325016 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec1f3570-38f4-4b35-9ed8-3299ac87da01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.325794 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec1f3570-38f4-4b35-9ed8-3299ac87da01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.326405 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec1f3570-38f4-4b35-9ed8-3299ac87da01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.414183 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ec1f3570-38f4-4b35-9ed8-3299ac87da01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.100813 Oct 27 14:09:19.416152 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 98/205] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:19 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:19.422634 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0f0af475-2339-4ec4-91e5-9d241946529e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:19.424156 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0f0af475-2339-4ec4-91e5-9d241946529e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:19.441726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-daa4fdd0-173f-4624-98c2-4acb1f17d234 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:19.441997 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0f0af475-2339-4ec4-91e5-9d241946529e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.442520 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0f0af475-2339-4ec4-91e5-9d241946529e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.443429 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0f0af475-2339-4ec4-91e5-9d241946529e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.444646 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0f0af475-2339-4ec4-91e5-9d241946529e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.452362 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-daa4fdd0-173f-4624-98c2-4acb1f17d234 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.272303 Oct 27 14:09:19.453171 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 108/206] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:19 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:19.484295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5225cc9e-e507-49bf-b1ab-6eb4a4fcfc05 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:19.485206 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5225cc9e-e507-49bf-b1ab-6eb4a4fcfc05 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:19.491361 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5225cc9e-e507-49bf-b1ab-6eb4a4fcfc05 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.491930 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5225cc9e-e507-49bf-b1ab-6eb4a4fcfc05 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.492784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5225cc9e-e507-49bf-b1ab-6eb4a4fcfc05 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.494693 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5225cc9e-e507-49bf-b1ab-6eb4a4fcfc05 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.565365 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0f0af475-2339-4ec4-91e5-9d241946529e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.147899 Oct 27 14:09:19.566008 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 99/207] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:19 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:19.629476 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4a297f95-dac2-4759-8374-870d8d1e370f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:19.630349 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4a297f95-dac2-4759-8374-870d8d1e370f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:19.638663 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4a297f95-dac2-4759-8374-870d8d1e370f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.639114 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4a297f95-dac2-4759-8374-870d8d1e370f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.639922 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4a297f95-dac2-4759-8374-870d8d1e370f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:19.640357 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4a297f95-dac2-4759-8374-870d8d1e370f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:19.705966 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5225cc9e-e507-49bf-b1ab-6eb4a4fcfc05 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:19.714665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5225cc9e-e507-49bf-b1ab-6eb4a4fcfc05 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1319 microversion: 2.1 time: 0.235194 Oct 27 14:09:19.715624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 109/208] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:19 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:19.875732 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4a297f95-dac2-4759-8374-870d8d1e370f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:19.884304 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4a297f95-dac2-4759-8374-870d8d1e370f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1317 microversion: 2.1 time: 0.260002 Oct 27 14:09:19.893884 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 100/209] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:19 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:20.021349 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-3592808c-8c24-4666-8cbf-b75161bfa2ed req-8b085563-cc84-48df-9427-7af9dd3be953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ae7a38-77b0-4cc7-966f-00e06098455d", "tag": "fd3f6935-186e-4efb-ae30-2528d5f42cf6"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:20.023027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:20.023027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:09:20.031890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-3592808c-8c24-4666-8cbf-b75161bfa2ed req-8b085563-cc84-48df-9427-7af9dd3be953 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.032534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-3592808c-8c24-4666-8cbf-b75161bfa2ed req-8b085563-cc84-48df-9427-7af9dd3be953 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:20.055615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-3592808c-8c24-4666-8cbf-b75161bfa2ed req-8b085563-cc84-48df-9427-7af9dd3be953 service nova] Creating event network-changed:fd3f6935-186e-4efb-ae30-2528d5f42cf6 for instance 16ae7a38-77b0-4cc7-966f-00e06098455d on hv-cinder-81566 Oct 27 14:09:20.062788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-3592808c-8c24-4666-8cbf-b75161bfa2ed req-8b085563-cc84-48df-9427-7af9dd3be953 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043699 Oct 27 14:09:20.062788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 110/210] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:20.278434 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e0a2e22a-e2e3-49d5-af8c-28ec7646b9bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:20.279318 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e0a2e22a-e2e3-49d5-af8c-28ec7646b9bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:20.286108 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e0a2e22a-e2e3-49d5-af8c-28ec7646b9bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.286816 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e0a2e22a-e2e3-49d5-af8c-28ec7646b9bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:20.287799 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e0a2e22a-e2e3-49d5-af8c-28ec7646b9bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.288227 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e0a2e22a-e2e3-49d5-af8c-28ec7646b9bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:20.426530 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-80c241a2-8db5-4b8c-b9aa-5088689c194d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:20.427624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-80c241a2-8db5-4b8c-b9aa-5088689c194d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:20.433773 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80c241a2-8db5-4b8c-b9aa-5088689c194d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.434231 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80c241a2-8db5-4b8c-b9aa-5088689c194d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:20.435001 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80c241a2-8db5-4b8c-b9aa-5088689c194d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.435496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80c241a2-8db5-4b8c-b9aa-5088689c194d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:20.518687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-80c241a2-8db5-4b8c-b9aa-5088689c194d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.096685 Oct 27 14:09:20.519331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 111/211] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:20 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:20.525904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0db75f7b-ba33-4840-8160-26846bcc113d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:20.526698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0db75f7b-ba33-4840-8160-26846bcc113d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:20.534097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0db75f7b-ba33-4840-8160-26846bcc113d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.534576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0db75f7b-ba33-4840-8160-26846bcc113d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:20.535392 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0db75f7b-ba33-4840-8160-26846bcc113d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.535822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0db75f7b-ba33-4840-8160-26846bcc113d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:20.642324 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e0a2e22a-e2e3-49d5-af8c-28ec7646b9bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:20.650539 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e0a2e22a-e2e3-49d5-af8c-28ec7646b9bd tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1552 microversion: 2.1 time: 0.376349 Oct 27 14:09:20.651025 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 101/212] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:20 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1552 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:20.663957 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-74e94872-1d76-4769-baf2-a9f9a622a65d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:20.664861 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-74e94872-1d76-4769-baf2-a9f9a622a65d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:20.671043 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-74e94872-1d76-4769-baf2-a9f9a622a65d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.671547 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-74e94872-1d76-4769-baf2-a9f9a622a65d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:20.672318 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-74e94872-1d76-4769-baf2-a9f9a622a65d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.672753 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-74e94872-1d76-4769-baf2-a9f9a622a65d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:20.774054 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-74e94872-1d76-4769-baf2-a9f9a622a65d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.112467 Oct 27 14:09:20.774740 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 102/213] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:20 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:09:20.779931 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-34dc8846-ab05-43b6-91b2-c7b4d085322a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:20.780621 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-34dc8846-ab05-43b6-91b2-c7b4d085322a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:20.787720 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-34dc8846-ab05-43b6-91b2-c7b4d085322a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.788148 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-34dc8846-ab05-43b6-91b2-c7b4d085322a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:20.788922 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-34dc8846-ab05-43b6-91b2-c7b4d085322a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:20.789345 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-34dc8846-ab05-43b6-91b2-c7b4d085322a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:21.173602 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0db75f7b-ba33-4840-8160-26846bcc113d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:21.181887 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0db75f7b-ba33-4840-8160-26846bcc113d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.661081 Oct 27 14:09:21.182466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 112/214] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:20 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:21.188633 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b3630d0e-248c-4021-ab19-66ad5879a494 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:21.189246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b3630d0e-248c-4021-ab19-66ad5879a494 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:21.195951 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3630d0e-248c-4021-ab19-66ad5879a494 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:21.197207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3630d0e-248c-4021-ab19-66ad5879a494 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:21.198372 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3630d0e-248c-4021-ab19-66ad5879a494 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:21.199090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3630d0e-248c-4021-ab19-66ad5879a494 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:21.230819 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-34dc8846-ab05-43b6-91b2-c7b4d085322a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:21.240083 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-34dc8846-ab05-43b6-91b2-c7b4d085322a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1319 microversion: 2.1 time: 0.463920 Oct 27 14:09:21.240778 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 103/215] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:20 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:21.517485 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b3630d0e-248c-4021-ab19-66ad5879a494 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:21.529454 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b3630d0e-248c-4021-ab19-66ad5879a494 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1317 microversion: 2.1 time: 0.345099 Oct 27 14:09:21.530097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 113/216] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:21 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:21.532214 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-38314074-16c3-4657-b99f-e510a2e80a88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:21.535445 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-38314074-16c3-4657-b99f-e510a2e80a88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:21.551564 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-38314074-16c3-4657-b99f-e510a2e80a88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:21.552388 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-38314074-16c3-4657-b99f-e510a2e80a88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:21.553399 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-38314074-16c3-4657-b99f-e510a2e80a88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:21.554051 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-38314074-16c3-4657-b99f-e510a2e80a88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:21.647669 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-38314074-16c3-4657-b99f-e510a2e80a88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.121152 Oct 27 14:09:21.648915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 104/217] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:21 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:21.668389 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dfdedba3-cca3-442f-b0c3-f45a1aef7d7d tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:21.669493 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dfdedba3-cca3-442f-b0c3-f45a1aef7d7d tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:21.676363 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfdedba3-cca3-442f-b0c3-f45a1aef7d7d tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:21.676722 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfdedba3-cca3-442f-b0c3-f45a1aef7d7d tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:21.677495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfdedba3-cca3-442f-b0c3-f45a1aef7d7d tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:21.677923 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfdedba3-cca3-442f-b0c3-f45a1aef7d7d tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:21.786716 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a783ba1e-b50b-43d9-8fe4-c4ac6d636684 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:21.787918 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a783ba1e-b50b-43d9-8fe4-c4ac6d636684 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:21.795169 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a783ba1e-b50b-43d9-8fe4-c4ac6d636684 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:21.802876 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a783ba1e-b50b-43d9-8fe4-c4ac6d636684 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:21.806487 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a783ba1e-b50b-43d9-8fe4-c4ac6d636684 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:21.807321 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a783ba1e-b50b-43d9-8fe4-c4ac6d636684 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:21.905712 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a783ba1e-b50b-43d9-8fe4-c4ac6d636684 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 14 microversion: 2.1 time: 0.123715 Oct 27 14:09:21.906354 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 105/218] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:21 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 14:09:21.912964 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-dfdedba3-cca3-442f-b0c3-f45a1aef7d7d tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:21.921505 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dfdedba3-cca3-442f-b0c3-f45a1aef7d7d tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1510 microversion: 2.1 time: 0.257737 Oct 27 14:09:21.922268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 114/219] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:21 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:22.076957 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-9f4cec66-b7c7-4fe3-a6a5-4209cbdb1812 req-dbe8f4f6-c0d5-4718-9d18-20a912447023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f33dcc-4df0-4c90-b5b3-6fab1b81faab", "name": "network-vif-deleted", "tag": "99d7fdc5-8676-4e9b-9ec5-5c8018f479cf"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:22.078834 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:22.078834 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:09:22.087492 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-9f4cec66-b7c7-4fe3-a6a5-4209cbdb1812 req-dbe8f4f6-c0d5-4718-9d18-20a912447023 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.088020 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-9f4cec66-b7c7-4fe3-a6a5-4209cbdb1812 req-dbe8f4f6-c0d5-4718-9d18-20a912447023 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.102725 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-9f4cec66-b7c7-4fe3-a6a5-4209cbdb1812 req-dbe8f4f6-c0d5-4718-9d18-20a912447023 service nova] Creating event network-vif-deleted:99d7fdc5-8676-4e9b-9ec5-5c8018f479cf for instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab on hv-cinder-81566 Oct 27 14:09:22.107892 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-9f4cec66-b7c7-4fe3-a6a5-4209cbdb1812 req-dbe8f4f6-c0d5-4718-9d18-20a912447023 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035886 Oct 27 14:09:22.108491 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 106/220] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:22.199548 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7c708dd7-82a2-4e4a-ab55-89b84554ac2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:22.200047 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7c708dd7-82a2-4e4a-ab55-89b84554ac2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:22.206275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7c708dd7-82a2-4e4a-ab55-89b84554ac2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.206714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7c708dd7-82a2-4e4a-ab55-89b84554ac2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.207665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7c708dd7-82a2-4e4a-ab55-89b84554ac2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.208087 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7c708dd7-82a2-4e4a-ab55-89b84554ac2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.260854 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-eff38cdc-a12e-4698-9eec-bf4b2e3e5b57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:22.261626 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-eff38cdc-a12e-4698-9eec-bf4b2e3e5b57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:22.269488 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-eff38cdc-a12e-4698-9eec-bf4b2e3e5b57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.270305 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-eff38cdc-a12e-4698-9eec-bf4b2e3e5b57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.271403 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-eff38cdc-a12e-4698-9eec-bf4b2e3e5b57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.271916 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-eff38cdc-a12e-4698-9eec-bf4b2e3e5b57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.428687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7c708dd7-82a2-4e4a-ab55-89b84554ac2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:22.438579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7c708dd7-82a2-4e4a-ab55-89b84554ac2e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.243391 Oct 27 14:09:22.449393 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 115/221] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:22 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:22.462730 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-eff38cdc-a12e-4698-9eec-bf4b2e3e5b57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:22.470116 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-eff38cdc-a12e-4698-9eec-bf4b2e3e5b57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1319 microversion: 2.1 time: 0.215294 Oct 27 14:09:22.470679 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 107/222] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:22 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:22.546236 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-28c3620c-5291-4e8c-82bc-4d264dac788c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:22.547004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-28c3620c-5291-4e8c-82bc-4d264dac788c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:22.553225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-28c3620c-5291-4e8c-82bc-4d264dac788c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.553726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-28c3620c-5291-4e8c-82bc-4d264dac788c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.554597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-28c3620c-5291-4e8c-82bc-4d264dac788c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.555048 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-28c3620c-5291-4e8c-82bc-4d264dac788c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.659674 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-54f30ec1-9800-4f50-93e6-e0f497133a84 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:22.660584 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-54f30ec1-9800-4f50-93e6-e0f497133a84 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:22.667108 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-54f30ec1-9800-4f50-93e6-e0f497133a84 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.667585 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-54f30ec1-9800-4f50-93e6-e0f497133a84 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.668370 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-54f30ec1-9800-4f50-93e6-e0f497133a84 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.668800 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-54f30ec1-9800-4f50-93e6-e0f497133a84 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.707504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-28c3620c-5291-4e8c-82bc-4d264dac788c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:22.715869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-28c3620c-5291-4e8c-82bc-4d264dac788c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1317 microversion: 2.1 time: 0.173226 Oct 27 14:09:22.716476 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 116/223] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:22 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:22.769164 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-54f30ec1-9800-4f50-93e6-e0f497133a84 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.113423 Oct 27 14:09:22.769804 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 108/224] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:22 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:22.922003 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d3f98d53-73b2-4deb-b2cd-a43a14a3d391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:22.923207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d3f98d53-73b2-4deb-b2cd-a43a14a3d391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:22.929817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3f98d53-73b2-4deb-b2cd-a43a14a3d391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.930700 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3f98d53-73b2-4deb-b2cd-a43a14a3d391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.931896 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3f98d53-73b2-4deb-b2cd-a43a14a3d391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.932551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3f98d53-73b2-4deb-b2cd-a43a14a3d391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.939482 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:22.940386 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:22.947959 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.948887 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.950104 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.951215 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.997425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:22.997876 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:22.998344 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.objects.instance [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lazy-loading 'fault' on Instance uuid c3f33dcc-4df0-4c90-b5b3-6fab1b81faab {{(pid=115932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:09:23.035847 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d3f98d53-73b2-4deb-b2cd-a43a14a3d391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 4341 microversion: 2.1 time: 0.122628 Oct 27 14:09:23.036776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 117/225] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:22 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 4341 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:23.058026 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a825da5391d48679f6b82d48b94d26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef26a68103c41df95d4610911087640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:23.064813 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-97f541ab-130a-4266-b6bf-4b2ea0a6b746 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 200 len: 1304 microversion: 2.1 time: 0.129755 Oct 27 14:09:23.065586 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 109/226] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:22 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:23.457885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-899c5279-d5c3-42e0-965b-954f141feb51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:23.458745 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-899c5279-d5c3-42e0-965b-954f141feb51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:23.467724 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-899c5279-d5c3-42e0-965b-954f141feb51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:23.468421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-899c5279-d5c3-42e0-965b-954f141feb51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:23.469343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-899c5279-d5c3-42e0-965b-954f141feb51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:23.469776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-899c5279-d5c3-42e0-965b-954f141feb51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:23.496509 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-91fa294c-9e7a-497f-bf41-5611c7f22235 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:23.498690 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-91fa294c-9e7a-497f-bf41-5611c7f22235 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:23.509154 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-91fa294c-9e7a-497f-bf41-5611c7f22235 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:23.510293 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-91fa294c-9e7a-497f-bf41-5611c7f22235 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:23.511330 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-91fa294c-9e7a-497f-bf41-5611c7f22235 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:23.511971 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-91fa294c-9e7a-497f-bf41-5611c7f22235 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:23.705708 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-899c5279-d5c3-42e0-965b-954f141feb51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:23.726546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-899c5279-d5c3-42e0-965b-954f141feb51 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.272794 Oct 27 14:09:23.737700 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-91fa294c-9e7a-497f-bf41-5611c7f22235 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:23.739176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 118/227] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:23 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:23.743920 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-91fa294c-9e7a-497f-bf41-5611c7f22235 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1319 microversion: 2.1 time: 0.254764 Oct 27 14:09:23.744852 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 110/228] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:23 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:23.745889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-5d9e0822-e513-4976-af2d-21546c0ef5bf req-1e019c02-ade2-460f-9a7a-b92f60d8f4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b67be3cc-1fc7-4fc3-bdd0-03c799491784", "name": "network-vif-plugged", "status": "completed", "tag": "9b8b3480-396e-4f51-94d1-f326ad7aef3e"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:23.747697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:23.747697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:09:23.752123 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c5a9261b-3cc1-4143-b4a0-36079f48b642 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:23.753108 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c5a9261b-3cc1-4143-b4a0-36079f48b642 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:23.756699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-5d9e0822-e513-4976-af2d-21546c0ef5bf req-1e019c02-ade2-460f-9a7a-b92f60d8f4ea service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:23.757285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-5d9e0822-e513-4976-af2d-21546c0ef5bf req-1e019c02-ade2-460f-9a7a-b92f60d8f4ea service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:23.761394 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c5a9261b-3cc1-4143-b4a0-36079f48b642 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:23.761852 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c5a9261b-3cc1-4143-b4a0-36079f48b642 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:23.763242 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c5a9261b-3cc1-4143-b4a0-36079f48b642 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:23.763242 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c5a9261b-3cc1-4143-b4a0-36079f48b642 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:23.770585 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5d9e0822-e513-4976-af2d-21546c0ef5bf req-1e019c02-ade2-460f-9a7a-b92f60d8f4ea service nova] Creating event network-vif-plugged:9b8b3480-396e-4f51-94d1-f326ad7aef3e for instance b67be3cc-1fc7-4fc3-bdd0-03c799491784 on hv-cinder-81566 Oct 27 14:09:23.784584 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-5d9e0822-e513-4976-af2d-21546c0ef5bf req-1e019c02-ade2-460f-9a7a-b92f60d8f4ea service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043669 Oct 27 14:09:23.785511 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 119/229] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:23.793420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5c8164d6-c10b-48ff-8f0d-070dbec6a482 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:23.795170 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5c8164d6-c10b-48ff-8f0d-070dbec6a482 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:23.801909 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c8164d6-c10b-48ff-8f0d-070dbec6a482 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:23.803066 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c8164d6-c10b-48ff-8f0d-070dbec6a482 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:23.804001 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c8164d6-c10b-48ff-8f0d-070dbec6a482 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:23.805018 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c8164d6-c10b-48ff-8f0d-070dbec6a482 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:23.904811 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5c8164d6-c10b-48ff-8f0d-070dbec6a482 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.117422 Oct 27 14:09:23.905449 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 120/230] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:23 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:23.930632 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c5a9261b-3cc1-4143-b4a0-36079f48b642 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:23.940100 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c5a9261b-3cc1-4143-b4a0-36079f48b642 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1317 microversion: 2.1 time: 0.194062 Oct 27 14:09:23.940757 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 111/231] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:23 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:24.048558 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c240b587-f8cb-4632-9196-b39480c35e5a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:24.049821 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c240b587-f8cb-4632-9196-b39480c35e5a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:24.057764 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c240b587-f8cb-4632-9196-b39480c35e5a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.058347 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c240b587-f8cb-4632-9196-b39480c35e5a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.059453 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c240b587-f8cb-4632-9196-b39480c35e5a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.060130 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c240b587-f8cb-4632-9196-b39480c35e5a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.082713 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d894f04e-89b3-40a7-8831-4ed2a5e820c2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:24.083666 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d894f04e-89b3-40a7-8831-4ed2a5e820c2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:24.091336 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d894f04e-89b3-40a7-8831-4ed2a5e820c2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.092166 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d894f04e-89b3-40a7-8831-4ed2a5e820c2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.093314 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d894f04e-89b3-40a7-8831-4ed2a5e820c2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.093824 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d894f04e-89b3-40a7-8831-4ed2a5e820c2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.116033 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-d894f04e-89b3-40a7-8831-4ed2a5e820c2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] HTTP exception thrown: Instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab could not be found. Oct 27 14:09:24.116895 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d894f04e-89b3-40a7-8831-4ed2a5e820c2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Returning 404 to user: Instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:09:24.118243 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d894f04e-89b3-40a7-8831-4ed2a5e820c2 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 404 len: 111 microversion: 2.1 time: 0.039113 Oct 27 14:09:24.119275 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 112/232] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:24 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:09:24.238329 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f637b876-f01b-477f-b268-33031b3f75cc tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:24.239606 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f637b876-f01b-477f-b268-33031b3f75cc tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:24.246584 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f637b876-f01b-477f-b268-33031b3f75cc tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.247039 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f637b876-f01b-477f-b268-33031b3f75cc tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.247858 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f637b876-f01b-477f-b268-33031b3f75cc tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.248293 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f637b876-f01b-477f-b268-33031b3f75cc tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.263842 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-f637b876-f01b-477f-b268-33031b3f75cc tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] HTTP exception thrown: Instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab could not be found. Oct 27 14:09:24.264541 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f637b876-f01b-477f-b268-33031b3f75cc tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Returning 404 to user: Instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:09:24.265827 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f637b876-f01b-477f-b268-33031b3f75cc tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032342 Oct 27 14:09:24.267734 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 113/233] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:09:24 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:09:24.429844 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c240b587-f8cb-4632-9196-b39480c35e5a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 11208 microversion: 2.1 time: 0.385068 Oct 27 14:09:24.430672 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 121/234] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:24 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 11208 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:24.745185 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-bf9c431e-220f-4a5e-9e6d-bcab1d5945d8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:24.745898 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-bf9c431e-220f-4a5e-9e6d-bcab1d5945d8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:24.752399 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bf9c431e-220f-4a5e-9e6d-bcab1d5945d8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.752840 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bf9c431e-220f-4a5e-9e6d-bcab1d5945d8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.753611 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bf9c431e-220f-4a5e-9e6d-bcab1d5945d8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.754040 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bf9c431e-220f-4a5e-9e6d-bcab1d5945d8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.761737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-44ac8e1c-f35a-4351-bbbd-190678cf4a07 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:24.762559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-44ac8e1c-f35a-4351-bbbd-190678cf4a07 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:24.769628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44ac8e1c-f35a-4351-bbbd-190678cf4a07 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.770078 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44ac8e1c-f35a-4351-bbbd-190678cf4a07 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.770855 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44ac8e1c-f35a-4351-bbbd-190678cf4a07 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.771431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44ac8e1c-f35a-4351-bbbd-190678cf4a07 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.937003 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-bf9c431e-220f-4a5e-9e6d-bcab1d5945d8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:24.944915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-bf9c431e-220f-4a5e-9e6d-bcab1d5945d8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.203948 Oct 27 14:09:24.945524 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 114/235] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:24 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:24.950701 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-50b20596-0667-4a4f-93d8-b06300157ff1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:24.951861 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-50b20596-0667-4a4f-93d8-b06300157ff1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:24.955786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-44ac8e1c-f35a-4351-bbbd-190678cf4a07 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:24.958379 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-50b20596-0667-4a4f-93d8-b06300157ff1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.958830 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-50b20596-0667-4a4f-93d8-b06300157ff1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.959635 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-50b20596-0667-4a4f-93d8-b06300157ff1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.960065 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-50b20596-0667-4a4f-93d8-b06300157ff1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.965398 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-44ac8e1c-f35a-4351-bbbd-190678cf4a07 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1319 microversion: 2.1 time: 0.208220 Oct 27 14:09:24.966016 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 122/236] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:24 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:24.971385 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fa33d8af-940e-4767-9620-cab784f9c636 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:24.972219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fa33d8af-940e-4767-9620-cab784f9c636 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:24.978713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa33d8af-940e-4767-9620-cab784f9c636 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.979360 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa33d8af-940e-4767-9620-cab784f9c636 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:24.980256 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa33d8af-940e-4767-9620-cab784f9c636 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:24.980717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa33d8af-940e-4767-9620-cab784f9c636 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.031863 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-50b20596-0667-4a4f-93d8-b06300157ff1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.085038 Oct 27 14:09:25.032508 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 115/237] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:24 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:25.113975 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fa33d8af-940e-4767-9620-cab784f9c636 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:25.122910 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fa33d8af-940e-4767-9620-cab784f9c636 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1317 microversion: 2.1 time: 0.155486 Oct 27 14:09:25.123580 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 123/238] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:24 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:25.442950 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-75090642-ecf4-4c77-bc4c-eba96c8aec2d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:25.444449 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-75090642-ecf4-4c77-bc4c-eba96c8aec2d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:25.451800 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-75090642-ecf4-4c77-bc4c-eba96c8aec2d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.452552 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-75090642-ecf4-4c77-bc4c-eba96c8aec2d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.453388 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-75090642-ecf4-4c77-bc4c-eba96c8aec2d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.453891 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-75090642-ecf4-4c77-bc4c-eba96c8aec2d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.465790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-135437d5-cbe0-4a9a-b685-d92074580977 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:25.466675 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-135437d5-cbe0-4a9a-b685-d92074580977 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:25.475842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-135437d5-cbe0-4a9a-b685-d92074580977 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.476820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-135437d5-cbe0-4a9a-b685-d92074580977 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.477949 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-135437d5-cbe0-4a9a-b685-d92074580977 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.479079 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-135437d5-cbe0-4a9a-b685-d92074580977 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.495691 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-135437d5-cbe0-4a9a-b685-d92074580977 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] HTTP exception thrown: Instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab could not be found. Oct 27 14:09:25.496315 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-135437d5-cbe0-4a9a-b685-d92074580977 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Returning 404 to user: Instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:09:25.497140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-135437d5-cbe0-4a9a-b685-d92074580977 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 404 len: 111 microversion: 2.1 time: 0.036019 Oct 27 14:09:25.497687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 124/239] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:09:25 2021] DELETE /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:09:25.505843 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4fecc0de-8472-4ac2-b3fd-2c14c6495d07 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:25.506656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4fecc0de-8472-4ac2-b3fd-2c14c6495d07 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] [instance: c3f33dcc-4df0-4c90-b5b3-6fab1b81faab] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:25.517250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fecc0de-8472-4ac2-b3fd-2c14c6495d07 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.519057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fecc0de-8472-4ac2-b3fd-2c14c6495d07 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.519960 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fecc0de-8472-4ac2-b3fd-2c14c6495d07 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.520458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fecc0de-8472-4ac2-b3fd-2c14c6495d07 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.534762 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-4fecc0de-8472-4ac2-b3fd-2c14c6495d07 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] HTTP exception thrown: Instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab could not be found. Oct 27 14:09:25.535388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4fecc0de-8472-4ac2-b3fd-2c14c6495d07 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] Returning 404 to user: Instance c3f33dcc-4df0-4c90-b5b3-6fab1b81faab could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:09:25.536249 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4fecc0de-8472-4ac2-b3fd-2c14c6495d07 tempest-DeleteServersTestJSON-24259725 tempest-DeleteServersTestJSON-24259725-project] 10.222.0.85 "GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab" status: 404 len: 111 microversion: 2.1 time: 0.034106 Oct 27 14:09:25.536803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 125/240] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:25 2021] GET /compute/v2.1/servers/c3f33dcc-4df0-4c90-b5b3-6fab1b81faab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:09:25.547976 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-75090642-ecf4-4c77-bc4c-eba96c8aec2d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 15025 microversion: 2.1 time: 0.108913 Oct 27 14:09:25.549639 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 116/241] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:25 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 15025 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:25.804069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-f00bde9d-fa37-482f-a33a-7e1cbfd85683 req-3ef51333-6cb8-4c48-90be-f1376885fbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ae7a38-77b0-4cc7-966f-00e06098455d", "name": "network-vif-plugged", "status": "completed", "tag": "fd3f6935-186e-4efb-ae30-2528d5f42cf6"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:25.807164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:25.807164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:09:25.816753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-f00bde9d-fa37-482f-a33a-7e1cbfd85683 req-3ef51333-6cb8-4c48-90be-f1376885fbfc service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.817595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-f00bde9d-fa37-482f-a33a-7e1cbfd85683 req-3ef51333-6cb8-4c48-90be-f1376885fbfc service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.839478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-f00bde9d-fa37-482f-a33a-7e1cbfd85683 req-3ef51333-6cb8-4c48-90be-f1376885fbfc service nova] Creating event network-vif-plugged:fd3f6935-186e-4efb-ae30-2528d5f42cf6 for instance 16ae7a38-77b0-4cc7-966f-00e06098455d on hv-cinder-81566 Oct 27 14:09:25.847776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-f00bde9d-fa37-482f-a33a-7e1cbfd85683 req-3ef51333-6cb8-4c48-90be-f1376885fbfc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048053 Oct 27 14:09:25.848375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 126/242] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:25.963895 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1ddf16eb-9fc3-4aea-a6c8-416a1e941981 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:25.964790 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1ddf16eb-9fc3-4aea-a6c8-416a1e941981 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:25.973195 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1ddf16eb-9fc3-4aea-a6c8-416a1e941981 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.974021 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1ddf16eb-9fc3-4aea-a6c8-416a1e941981 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.981212 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1ddf16eb-9fc3-4aea-a6c8-416a1e941981 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.981666 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1ddf16eb-9fc3-4aea-a6c8-416a1e941981 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.985176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-76edee0c-8697-4268-bab0-d3361df08a0a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:25.985875 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-76edee0c-8697-4268-bab0-d3361df08a0a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:25.993495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76edee0c-8697-4268-bab0-d3361df08a0a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.994427 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76edee0c-8697-4268-bab0-d3361df08a0a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:25.996696 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76edee0c-8697-4268-bab0-d3361df08a0a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:25.997360 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76edee0c-8697-4268-bab0-d3361df08a0a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.248450 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1ddf16eb-9fc3-4aea-a6c8-416a1e941981 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:26.251668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-76edee0c-8697-4268-bab0-d3361df08a0a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:26.258534 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1ddf16eb-9fc3-4aea-a6c8-416a1e941981 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.299440 Oct 27 14:09:26.258845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-76edee0c-8697-4268-bab0-d3361df08a0a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1319 microversion: 2.1 time: 0.278267 Oct 27 14:09:26.259337 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 117/243] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:25 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:26.260013 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 127/244] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:25 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:26.264875 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8cb324ed-a570-448a-9e67-8a1ba0c7fc7a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:26.265722 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8cb324ed-a570-448a-9e67-8a1ba0c7fc7a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:26.274074 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8cb324ed-a570-448a-9e67-8a1ba0c7fc7a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:26.274743 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e227044c-fdfd-459f-88e1-8631ea19c82f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:26.278773 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8cb324ed-a570-448a-9e67-8a1ba0c7fc7a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.279099 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e227044c-fdfd-459f-88e1-8631ea19c82f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:26.279219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8cb324ed-a570-448a-9e67-8a1ba0c7fc7a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:26.279219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8cb324ed-a570-448a-9e67-8a1ba0c7fc7a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.288058 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e227044c-fdfd-459f-88e1-8631ea19c82f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:26.288507 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e227044c-fdfd-459f-88e1-8631ea19c82f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.289280 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e227044c-fdfd-459f-88e1-8631ea19c82f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:26.289851 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e227044c-fdfd-459f-88e1-8631ea19c82f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.409165 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8cb324ed-a570-448a-9e67-8a1ba0c7fc7a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:26.417333 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8cb324ed-a570-448a-9e67-8a1ba0c7fc7a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1507 microversion: 2.1 time: 0.156145 Oct 27 14:09:26.417996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 128/245] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:26 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:26.436755 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-591194f0-f37d-4827-8b59-5cf61aa1ccad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6c2d59a-f0f4-4f52-9356-c3efc642a735"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:26.437809 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-591194f0-f37d-4827-8b59-5cf61aa1ccad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:26.443967 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-591194f0-f37d-4827-8b59-5cf61aa1ccad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:26.444491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-591194f0-f37d-4827-8b59-5cf61aa1ccad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.445596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-591194f0-f37d-4827-8b59-5cf61aa1ccad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:26.446096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-591194f0-f37d-4827-8b59-5cf61aa1ccad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.535772 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-591194f0-f37d-4827-8b59-5cf61aa1ccad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] HTTP exception thrown: Invalid volume: volume d6c2d59a-f0f4-4f52-9356-c3efc642a735 is already attached to instances: 1e098f1a-7a67-49aa-8612-ecf546da5a62 Oct 27 14:09:26.536376 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-591194f0-f37d-4827-8b59-5cf61aa1ccad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Returning 400 to user: Invalid volume: volume d6c2d59a-f0f4-4f52-9356-c3efc642a735 is already attached to instances: 1e098f1a-7a67-49aa-8612-ecf546da5a62 {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:09:26.537203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-591194f0-f37d-4827-8b59-5cf61aa1ccad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "POST /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105711 Oct 27 14:09:26.537784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 129/246] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:09:26 2021] POST /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 14:09:26.546040 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e227044c-fdfd-459f-88e1-8631ea19c82f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.274994 Oct 27 14:09:26.549817 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 118/247] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:26 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:26.560674 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e5096b62-25f0-4cb1-b265-eebf885d44a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:26.561729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e5096b62-25f0-4cb1-b265-eebf885d44a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:26.571265 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5096b62-25f0-4cb1-b265-eebf885d44a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:26.571909 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5096b62-25f0-4cb1-b265-eebf885d44a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.572992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5096b62-25f0-4cb1-b265-eebf885d44a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:26.573606 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5096b62-25f0-4cb1-b265-eebf885d44a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.608205 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2508ab4e-7c6a-4bd1-8021-4417d7e5c2ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:26.608780 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2508ab4e-7c6a-4bd1-8021-4417d7e5c2ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:26.615723 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2508ab4e-7c6a-4bd1-8021-4417d7e5c2ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:26.616055 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2508ab4e-7c6a-4bd1-8021-4417d7e5c2ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.616834 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2508ab4e-7c6a-4bd1-8021-4417d7e5c2ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:26.617274 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2508ab4e-7c6a-4bd1-8021-4417d7e5c2ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:26.681172 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e5096b62-25f0-4cb1-b265-eebf885d44a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 17297 microversion: 2.1 time: 0.124360 Oct 27 14:09:26.681986 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 130/248] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:26 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 17297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:26.744562 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.objects.instance [None req-2508ab4e-7c6a-4bd1-8021-4417d7e5c2ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lazy-loading 'services' on Instance uuid 1e098f1a-7a67-49aa-8612-ecf546da5a62 {{(pid=115932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:09:27.006890 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2508ab4e-7c6a-4bd1-8021-4417d7e5c2ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62/os-volume_attachments/d6c2d59a-f0f4-4f52-9356-c3efc642a735" status: 202 len: 0 microversion: 2.1 time: 0.403387 Oct 27 14:09:27.008069 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 119/249] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:09:26 2021] DELETE /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62/os-volume_attachments/d6c2d59a-f0f4-4f52-9356-c3efc642a735 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:09:27.017471 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-87139576-bbfc-497d-abf0-aaa44356d43b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:27.018470 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-87139576-bbfc-497d-abf0-aaa44356d43b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:27.027235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87139576-bbfc-497d-abf0-aaa44356d43b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:27.027698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87139576-bbfc-497d-abf0-aaa44356d43b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:27.028558 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87139576-bbfc-497d-abf0-aaa44356d43b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:27.029686 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87139576-bbfc-497d-abf0-aaa44356d43b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:27.061175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-87139576-bbfc-497d-abf0-aaa44356d43b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047911 Oct 27 14:09:27.061740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 131/250] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:09:27 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:27.277016 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-961a5af6-78a1-460c-8e3d-73dcdbb5572b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:27.277624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-961a5af6-78a1-460c-8e3d-73dcdbb5572b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:27.284067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-961a5af6-78a1-460c-8e3d-73dcdbb5572b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:27.284509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-961a5af6-78a1-460c-8e3d-73dcdbb5572b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:27.285274 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-961a5af6-78a1-460c-8e3d-73dcdbb5572b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:27.285698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-961a5af6-78a1-460c-8e3d-73dcdbb5572b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:27.382383 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0eab9b09-8485-4dc5-b792-51746c1916c3 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Action: 'create', calling method: .version_select at 0x7f45701010d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-684958432"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:27.418798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-961a5af6-78a1-460c-8e3d-73dcdbb5572b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:27.426626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-961a5af6-78a1-460c-8e3d-73dcdbb5572b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.153603 Oct 27 14:09:27.427215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 132/251] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:27 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:27.432125 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9c5812ee-616e-4c28-ab3c-413cdb23cb29 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:27.432731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9c5812ee-616e-4c28-ab3c-413cdb23cb29 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:27.438301 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9c5812ee-616e-4c28-ab3c-413cdb23cb29 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:27.438748 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9c5812ee-616e-4c28-ab3c-413cdb23cb29 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:27.439540 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9c5812ee-616e-4c28-ab3c-413cdb23cb29 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:27.440129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9c5812ee-616e-4c28-ab3c-413cdb23cb29 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:27.575408 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9c5812ee-616e-4c28-ab3c-413cdb23cb29 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:27.582871 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9c5812ee-616e-4c28-ab3c-413cdb23cb29 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1319 microversion: 2.1 time: 0.154406 Oct 27 14:09:27.583469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 133/252] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:27 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:27.598505 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-aacacf05-a08d-442e-9f00-21d2ad6f9f5a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:27.599551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-aacacf05-a08d-442e-9f00-21d2ad6f9f5a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:27.607102 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aacacf05-a08d-442e-9f00-21d2ad6f9f5a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:27.607760 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aacacf05-a08d-442e-9f00-21d2ad6f9f5a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:27.608550 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aacacf05-a08d-442e-9f00-21d2ad6f9f5a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:27.608980 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aacacf05-a08d-442e-9f00-21d2ad6f9f5a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:27.688296 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0eab9b09-8485-4dc5-b792-51746c1916c3 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.423614 Oct 27 14:09:27.689509 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 120/253] 10.222.0.85 () {60 vars in 1154 bytes} [Wed Oct 27 14:09:27 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 426 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 14:09:27.694223 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-55360db2-b4a4-4386-b177-0d585a18199a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:27.695615 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-55360db2-b4a4-4386-b177-0d585a18199a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:27.703459 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-55360db2-b4a4-4386-b177-0d585a18199a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:27.703931 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-55360db2-b4a4-4386-b177-0d585a18199a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:27.704719 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-55360db2-b4a4-4386-b177-0d585a18199a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:27.705152 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-55360db2-b4a4-4386-b177-0d585a18199a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:27.755209 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-aacacf05-a08d-442e-9f00-21d2ad6f9f5a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.161450 Oct 27 14:09:27.755869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 134/254] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:27 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:27.761397 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f99285d3-49ad-4753-bbc7-80df623743b7 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f4570968790>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:27.811935 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-55360db2-b4a4-4386-b177-0d585a18199a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 17629 microversion: 2.1 time: 0.121009 Oct 27 14:09:27.812095 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f99285d3-49ad-4753-bbc7-80df623743b7 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7" status: 200 len: 344 microversion: 2.1 time: 0.054907 Oct 27 14:09:27.812594 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 135/255] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:09:27 2021] GET /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:27.813761 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 121/256] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:27 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 17629 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:28.073779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b07440f6-e73d-4f97-9588-5c34775fd7cc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:28.074789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b07440f6-e73d-4f97-9588-5c34775fd7cc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:28.081222 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b07440f6-e73d-4f97-9588-5c34775fd7cc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:28.081670 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b07440f6-e73d-4f97-9588-5c34775fd7cc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:28.082445 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b07440f6-e73d-4f97-9588-5c34775fd7cc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:28.083074 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b07440f6-e73d-4f97-9588-5c34775fd7cc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:28.111905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b07440f6-e73d-4f97-9588-5c34775fd7cc tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043206 Oct 27 14:09:28.112440 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 136/257] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:09:28 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:28.444766 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c0330f61-1884-42bf-bd7a-6505ff6d3d2d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:28.445458 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c0330f61-1884-42bf-bd7a-6505ff6d3d2d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:28.453069 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c0330f61-1884-42bf-bd7a-6505ff6d3d2d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:28.453620 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c0330f61-1884-42bf-bd7a-6505ff6d3d2d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:28.454474 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c0330f61-1884-42bf-bd7a-6505ff6d3d2d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:28.454916 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c0330f61-1884-42bf-bd7a-6505ff6d3d2d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:28.583775 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c0330f61-1884-42bf-bd7a-6505ff6d3d2d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:28.592403 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c0330f61-1884-42bf-bd7a-6505ff6d3d2d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.151418 Oct 27 14:09:28.593067 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 122/258] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:28 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:28.599805 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b6b7c278-aeda-4972-a4a5-cc78318b98ed tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:28.600409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b6b7c278-aeda-4972-a4a5-cc78318b98ed tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:28.606828 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b6b7c278-aeda-4972-a4a5-cc78318b98ed tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:28.607298 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b6b7c278-aeda-4972-a4a5-cc78318b98ed tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:28.608069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b6b7c278-aeda-4972-a4a5-cc78318b98ed tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:28.608490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b6b7c278-aeda-4972-a4a5-cc78318b98ed tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:28.738917 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b6b7c278-aeda-4972-a4a5-cc78318b98ed tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:28.747426 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b6b7c278-aeda-4972-a4a5-cc78318b98ed tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1508 microversion: 2.1 time: 0.151067 Oct 27 14:09:28.747992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 137/259] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:28 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:28.766826 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f28d3c2c-85ea-4eaf-b2e2-4f0416351c19 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:28.767976 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f28d3c2c-85ea-4eaf-b2e2-4f0416351c19 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:28.774554 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f28d3c2c-85ea-4eaf-b2e2-4f0416351c19 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:28.774994 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f28d3c2c-85ea-4eaf-b2e2-4f0416351c19 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:28.776303 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f28d3c2c-85ea-4eaf-b2e2-4f0416351c19 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:28.776831 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f28d3c2c-85ea-4eaf-b2e2-4f0416351c19 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:28.824509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c7eeffa7-ec7e-4bd6-b2e5-7d1b7afe6e7f tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f4570960dc0>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:28.863226 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f28d3c2c-85ea-4eaf-b2e2-4f0416351c19 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 14 microversion: 2.20 time: 0.100179 Oct 27 14:09:28.864153 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 123/260] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:28 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:28.869739 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-17f68bcf-fe04-46a7-abb8-b15e2f79f5da tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:28.871117 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-17f68bcf-fe04-46a7-abb8-b15e2f79f5da tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:28.877535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c7eeffa7-ec7e-4bd6-b2e5-7d1b7afe6e7f tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7" status: 200 len: 345 microversion: 2.1 time: 0.057408 Oct 27 14:09:28.878264 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 138/261] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:09:28 2021] GET /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:09:28.885553 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17f68bcf-fe04-46a7-abb8-b15e2f79f5da tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:28.886018 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17f68bcf-fe04-46a7-abb8-b15e2f79f5da tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:28.886858 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17f68bcf-fe04-46a7-abb8-b15e2f79f5da tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:28.887362 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17f68bcf-fe04-46a7-abb8-b15e2f79f5da tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:28.889611 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-33dd1546-e549-467d-966e-b7a6d9780b62 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Action: 'create', calling method: .version_select at 0x7f4570960160>, body: {"snapshot": {"volume_id": "bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1538792401"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:28.986169 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-17f68bcf-fe04-46a7-abb8-b15e2f79f5da tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 18110 microversion: 2.1 time: 0.120706 Oct 27 14:09:28.986847 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 124/262] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:28 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 18110 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:29.043443 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-33dd1546-e549-467d-966e-b7a6d9780b62 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.157293 Oct 27 14:09:29.044137 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 139/263] 10.222.0.85 () {60 vars in 1161 bytes} [Wed Oct 27 14:09:28 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:09:29.054626 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-98b5bb51-2adf-4258-be24-ec5525e48eb8 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f45701ae040>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:29.085047 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-98b5bb51-2adf-4258-be24-ec5525e48eb8 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209" status: 200 len: 287 microversion: 2.1 time: 0.034682 Oct 27 14:09:29.085589 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 125/264] 10.222.0.85 () {58 vars in 1250 bytes} [Wed Oct 27 14:09:29 2021] GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:09:29.095765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-89433eb2-14de-497c-b80f-260be8717525 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f457092b040>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:29.124962 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-5f6fce3a-2ec8-4f1a-a254-d491c004b7bb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:29.126028 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-5f6fce3a-2ec8-4f1a-a254-d491c004b7bb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:29.126148 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-89433eb2-14de-497c-b80f-260be8717525 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033867 Oct 27 14:09:29.126920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 140/265] 10.222.0.85 () {58 vars in 1139 bytes} [Wed Oct 27 14:09:29 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:09:29.132903 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5f6fce3a-2ec8-4f1a-a254-d491c004b7bb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:29.133361 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5f6fce3a-2ec8-4f1a-a254-d491c004b7bb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:29.134136 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5f6fce3a-2ec8-4f1a-a254-d491c004b7bb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:29.135241 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5f6fce3a-2ec8-4f1a-a254-d491c004b7bb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:29.137297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3228b18e-dd87-446d-a504-f7f83a1ae7ac tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f457098cee0>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:29.167492 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3228b18e-dd87-446d-a504-f7f83a1ae7ac tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209" status: 200 len: 287 microversion: 2.1 time: 0.034483 Oct 27 14:09:29.168067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 141/266] 10.222.0.85 () {58 vars in 1250 bytes} [Wed Oct 27 14:09:29 2021] GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:09:29.168791 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-5f6fce3a-2ec8-4f1a-a254-d491c004b7bb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049528 Oct 27 14:09:29.169363 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 126/267] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:09:29 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 14:09:29.368175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-66778580", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "networks": [{"uuid": "5b53c648-0313-4179-8334-9fa5d1933987"}]}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:29.610120 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2f67584c-eb85-4378-b49d-2e704f2e7ebc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:29.610731 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2f67584c-eb85-4378-b49d-2e704f2e7ebc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:29.616980 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2f67584c-eb85-4378-b49d-2e704f2e7ebc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:29.617429 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2f67584c-eb85-4378-b49d-2e704f2e7ebc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:29.618198 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2f67584c-eb85-4378-b49d-2e704f2e7ebc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:29.618635 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2f67584c-eb85-4378-b49d-2e704f2e7ebc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:29.742609 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2f67584c-eb85-4378-b49d-2e704f2e7ebc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:29.751973 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2f67584c-eb85-4378-b49d-2e704f2e7ebc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.145142 Oct 27 14:09:29.752559 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 127/268] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:29 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:29.874864 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d91c266f-5c69-44b7-ac40-138d0a85b519 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:29.875761 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d91c266f-5c69-44b7-ac40-138d0a85b519 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:29.882221 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d91c266f-5c69-44b7-ac40-138d0a85b519 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:29.882662 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d91c266f-5c69-44b7-ac40-138d0a85b519 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:29.883461 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d91c266f-5c69-44b7-ac40-138d0a85b519 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:29.883897 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d91c266f-5c69-44b7-ac40-138d0a85b519 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:33.806696 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d91c266f-5c69-44b7-ac40-138d0a85b519 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 7043 microversion: 2.20 time: 3.935400 Oct 27 14:09:33.807942 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 128/269] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:29 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 7043 bytes in 3938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:09:33.813833 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-3160cea7-ec9f-4322-89bd-f4f5e9f0db1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:33.814835 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-3160cea7-ec9f-4322-89bd-f4f5e9f0db1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:33.821887 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3160cea7-ec9f-4322-89bd-f4f5e9f0db1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:33.822335 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3160cea7-ec9f-4322-89bd-f4f5e9f0db1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:33.823103 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3160cea7-ec9f-4322-89bd-f4f5e9f0db1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:33.823564 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3160cea7-ec9f-4322-89bd-f4f5e9f0db1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:33.935253 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-3160cea7-ec9f-4322-89bd-f4f5e9f0db1b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 23129 microversion: 2.1 time: 0.125238 Oct 27 14:09:33.935912 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 129/270] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:33 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 23129 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:33.940684 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7f48326d-5427-4740-b288-91b012127927 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f4570106790>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:33.969960 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7f48326d-5427-4740-b288-91b012127927 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209" status: 200 len: 287 microversion: 2.1 time: 0.032856 Oct 27 14:09:33.970534 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 130/271] 10.222.0.85 () {58 vars in 1250 bytes} [Wed Oct 27 14:09:33 2021] GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:33.974885 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ae110af3-7034-4a32-9cd5-a9441349942b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:33.975640 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ae110af3-7034-4a32-9cd5-a9441349942b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:33.983614 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ae110af3-7034-4a32-9cd5-a9441349942b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:33.984072 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ae110af3-7034-4a32-9cd5-a9441349942b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:33.984844 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ae110af3-7034-4a32-9cd5-a9441349942b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:33.985288 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ae110af3-7034-4a32-9cd5-a9441349942b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:34.113388 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ae110af3-7034-4a32-9cd5-a9441349942b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:34.121543 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ae110af3-7034-4a32-9cd5-a9441349942b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.149546 Oct 27 14:09:34.129014 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 131/272] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:33 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:34.818719 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-330477a7-b2d2-4bb2-8e9d-f48d70bc1b0a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:34.819657 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-330477a7-b2d2-4bb2-8e9d-f48d70bc1b0a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:34.826708 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-330477a7-b2d2-4bb2-8e9d-f48d70bc1b0a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:34.827165 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-330477a7-b2d2-4bb2-8e9d-f48d70bc1b0a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:34.827933 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-330477a7-b2d2-4bb2-8e9d-f48d70bc1b0a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:34.828363 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-330477a7-b2d2-4bb2-8e9d-f48d70bc1b0a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:34.942763 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-330477a7-b2d2-4bb2-8e9d-f48d70bc1b0a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 10893 microversion: 2.20 time: 0.127519 Oct 27 14:09:34.943380 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 132/273] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:34 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 10893 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:09:34.948195 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-fa275014-059d-4e8c-9b2a-cc7c2f19bd9d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:34.949169 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-fa275014-059d-4e8c-9b2a-cc7c2f19bd9d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:34.956816 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa275014-059d-4e8c-9b2a-cc7c2f19bd9d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:34.957263 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa275014-059d-4e8c-9b2a-cc7c2f19bd9d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:34.958030 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa275014-059d-4e8c-9b2a-cc7c2f19bd9d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:34.958569 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa275014-059d-4e8c-9b2a-cc7c2f19bd9d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:35.078155 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-fa275014-059d-4e8c-9b2a-cc7c2f19bd9d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 23791 microversion: 2.1 time: 0.133373 Oct 27 14:09:35.078830 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 133/274] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:34 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 23791 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:35.083660 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-bce4f33a-9f4d-40c7-bb3a-36e23103911f tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f457009b550>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:35.113969 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-bce4f33a-9f4d-40c7-bb3a-36e23103911f tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209" status: 200 len: 288 microversion: 2.1 time: 0.033928 Oct 27 14:09:35.114544 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 134/275] 10.222.0.85 () {58 vars in 1250 bytes} [Wed Oct 27 14:09:35 2021] GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:35.125190 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-641caa16-e98d-445b-9bd0-dd4667a616e0 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f45709f2310>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:35.184929 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-641caa16-e98d-445b-9bd0-dd4667a616e0 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "DELETE /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209" status: 202 len: 0 microversion: 2.1 time: 0.062503 Oct 27 14:09:35.185524 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 135/276] 10.222.0.85 () {58 vars in 1253 bytes} [Wed Oct 27 14:09:35 2021] DELETE /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:09:35.189856 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-9226b6d8-536e-4aaf-a320-9a1d1bcd1ad2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:35.190617 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-9226b6d8-536e-4aaf-a320-9a1d1bcd1ad2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:35.197499 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9226b6d8-536e-4aaf-a320-9a1d1bcd1ad2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:35.197917 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9226b6d8-536e-4aaf-a320-9a1d1bcd1ad2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:35.198685 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9226b6d8-536e-4aaf-a320-9a1d1bcd1ad2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:35.199188 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9226b6d8-536e-4aaf-a320-9a1d1bcd1ad2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:35.325565 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-9226b6d8-536e-4aaf-a320-9a1d1bcd1ad2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:35.333240 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-9226b6d8-536e-4aaf-a320-9a1d1bcd1ad2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.146709 Oct 27 14:09:35.333820 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 136/277] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:35 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:35.338217 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-da3a7807-e24c-49bd-93aa-5fc8861d8354 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f4570070280>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:35.368456 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-da3a7807-e24c-49bd-93aa-5fc8861d8354 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209" status: 200 len: 287 microversion: 2.1 time: 0.033580 Oct 27 14:09:35.369024 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 137/278] 10.222.0.85 () {58 vars in 1250 bytes} [Wed Oct 27 14:09:35 2021] GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:35.954502 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0e4eb25a-62f4-4806-ab73-737542758426 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:35.955350 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0e4eb25a-62f4-4806-ab73-737542758426 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:35.962647 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0e4eb25a-62f4-4806-ab73-737542758426 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:35.963208 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0e4eb25a-62f4-4806-ab73-737542758426 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:35.964015 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0e4eb25a-62f4-4806-ab73-737542758426 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:35.964573 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0e4eb25a-62f4-4806-ab73-737542758426 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:36.052095 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0e4eb25a-62f4-4806-ab73-737542758426 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 15064 microversion: 2.20 time: 0.101681 Oct 27 14:09:36.052746 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 138/279] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:35 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 15064 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:09:36.090599 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-56675eff-983a-48c1-88cd-bdaf6db22c4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:36.091638 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-56675eff-983a-48c1-88cd-bdaf6db22c4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:36.098827 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-56675eff-983a-48c1-88cd-bdaf6db22c4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:36.099314 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-56675eff-983a-48c1-88cd-bdaf6db22c4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:36.100102 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-56675eff-983a-48c1-88cd-bdaf6db22c4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:36.100540 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-56675eff-983a-48c1-88cd-bdaf6db22c4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:36.206779 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-56675eff-983a-48c1-88cd-bdaf6db22c4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 24590 microversion: 2.1 time: 0.120076 Oct 27 14:09:36.207741 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 139/280] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:36 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 24590 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:09:36.351529 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-018a3a5c-e508-4ac0-829a-4a2b2bad71d7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:36.352339 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-018a3a5c-e508-4ac0-829a-4a2b2bad71d7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:36.360734 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-018a3a5c-e508-4ac0-829a-4a2b2bad71d7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:36.361264 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-018a3a5c-e508-4ac0-829a-4a2b2bad71d7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:36.362368 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-018a3a5c-e508-4ac0-829a-4a2b2bad71d7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:36.362799 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-018a3a5c-e508-4ac0-829a-4a2b2bad71d7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:36.492134 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-018a3a5c-e508-4ac0-829a-4a2b2bad71d7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:36.499959 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-018a3a5c-e508-4ac0-829a-4a2b2bad71d7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.152489 Oct 27 14:09:36.500529 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 140/281] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:36 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:36.504961 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8ebe3d14-42ec-436b-9c5b-9dff5cf0b134 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f4572025dc0>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:36.529449 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-8ebe3d14-42ec-436b-9c5b-9dff5cf0b134 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] HTTP exception thrown: Snapshot 15538538-cc9d-4108-9657-246db92e0209 could not be found. Oct 27 14:09:36.530072 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8ebe3d14-42ec-436b-9c5b-9dff5cf0b134 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Returning 404 to user: Snapshot 15538538-cc9d-4108-9657-246db92e0209 could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:09:36.530893 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-8ebe3d14-42ec-436b-9c5b-9dff5cf0b134 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209" status: 404 len: 111 microversion: 2.1 time: 0.029465 Oct 27 14:09:36.531474 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 141/282] 10.222.0.85 () {58 vars in 1250 bytes} [Wed Oct 27 14:09:36 2021] GET /compute/v2.1/os-snapshots/15538538-cc9d-4108-9657-246db92e0209 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:09:36.539650 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-53bed6a3-7d3d-42d2-8248-e4dfec2b54f0 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f45709f25e0>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:36.601892 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-53bed6a3-7d3d-42d2-8248-e4dfec2b54f0 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7" status: 202 len: 0 microversion: 2.1 time: 0.066203 Oct 27 14:09:36.602512 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 142/283] 10.222.0.85 () {58 vars in 1247 bytes} [Wed Oct 27 14:09:36 2021] DELETE /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:09:36.610126 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-06151fd3-b237-49ad-a65e-4f6353d63281 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f4570a4e790>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:36.656218 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-06151fd3-b237-49ad-a65e-4f6353d63281 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7" status: 200 len: 344 microversion: 2.1 time: 0.049498 Oct 27 14:09:36.656882 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 143/284] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:09:36 2021] GET /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:09:37.065046 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-71f4a2d2-77c4-48ac-9166-f111fcfc5654 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:37.065942 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-71f4a2d2-77c4-48ac-9166-f111fcfc5654 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:37.072811 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-71f4a2d2-77c4-48ac-9166-f111fcfc5654 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:37.073258 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-71f4a2d2-77c4-48ac-9166-f111fcfc5654 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:37.074025 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-71f4a2d2-77c4-48ac-9166-f111fcfc5654 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:37.074462 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-71f4a2d2-77c4-48ac-9166-f111fcfc5654 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:37.192677 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-71f4a2d2-77c4-48ac-9166-f111fcfc5654 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 17250 microversion: 2.20 time: 0.132602 Oct 27 14:09:37.193571 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 144/285] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:37 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 17250 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:09:37.218482 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-77a98a6d-0c32-418b-be03-8305b2611c1d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:37.219516 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-77a98a6d-0c32-418b-be03-8305b2611c1d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:37.226601 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-77a98a6d-0c32-418b-be03-8305b2611c1d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:37.227048 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-77a98a6d-0c32-418b-be03-8305b2611c1d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:37.227852 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-77a98a6d-0c32-418b-be03-8305b2611c1d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:37.228288 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-77a98a6d-0c32-418b-be03-8305b2611c1d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:37.340707 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-77a98a6d-0c32-418b-be03-8305b2611c1d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 25347 microversion: 2.1 time: 0.126012 Oct 27 14:09:37.341568 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 145/286] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:37 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 25347 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:09:37.518290 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b60c28c6-394b-4708-8749-b19f3cc821ab tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:37.519035 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-b60c28c6-394b-4708-8749-b19f3cc821ab tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:37.525835 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b60c28c6-394b-4708-8749-b19f3cc821ab tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:37.526278 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b60c28c6-394b-4708-8749-b19f3cc821ab tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:37.527044 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b60c28c6-394b-4708-8749-b19f3cc821ab tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:37.527502 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b60c28c6-394b-4708-8749-b19f3cc821ab tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:37.651980 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-b60c28c6-394b-4708-8749-b19f3cc821ab tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:37.660523 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b60c28c6-394b-4708-8749-b19f3cc821ab tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.146260 Oct 27 14:09:37.661118 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 146/287] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:37 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:37.668119 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-5be936f6-3d0a-44be-b6b7-9fe11867a593 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f457014b430>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:37.695111 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-5be936f6-3d0a-44be-b6b7-9fe11867a593 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] HTTP exception thrown: Volume bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 could not be found. Oct 27 14:09:37.695736 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-5be936f6-3d0a-44be-b6b7-9fe11867a593 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Returning 404 to user: Volume bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:09:37.696567 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-5be936f6-3d0a-44be-b6b7-9fe11867a593 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7" status: 404 len: 109 microversion: 2.1 time: 0.032003 Oct 27 14:09:37.697103 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 147/288] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:09:37 2021] GET /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:09:37.711305 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-31be46fe-d578-4340-ad8d-84789d95d247 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f4570aa1430>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:37.741082 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-31be46fe-d578-4340-ad8d-84789d95d247 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] HTTP exception thrown: Volume bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 could not be found. Oct 27 14:09:37.741665 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-31be46fe-d578-4340-ad8d-84789d95d247 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Returning 404 to user: Volume bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:09:37.742478 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-31be46fe-d578-4340-ad8d-84789d95d247 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7" status: 404 len: 109 microversion: 2.1 time: 0.035626 Oct 27 14:09:37.743012 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 148/289] 10.222.0.85 () {58 vars in 1247 bytes} [Wed Oct 27 14:09:37 2021] DELETE /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:09:37.750689 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f62d0e1e-5d06-4aed-9f9f-21e068a0f188 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Calling method '.version_select at 0x7f457014b9d0>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:37.778068 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-f62d0e1e-5d06-4aed-9f9f-21e068a0f188 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] HTTP exception thrown: Volume bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 could not be found. Oct 27 14:09:37.779354 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f62d0e1e-5d06-4aed-9f9f-21e068a0f188 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] Returning 404 to user: Volume bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:09:37.780209 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f62d0e1e-5d06-4aed-9f9f-21e068a0f188 tempest-VolumesSnapshotsTestJSON-447494879 tempest-VolumesSnapshotsTestJSON-447494879-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7" status: 404 len: 109 microversion: 2.1 time: 0.033228 Oct 27 14:09:37.780946 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 149/290] 10.222.0.85 () {58 vars in 1244 bytes} [Wed Oct 27 14:09:37 2021] GET /compute/v2.1/os-volumes/bb36b559-0a30-4e6e-8b92-5b5ec31cf0f7 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:09:38.206161 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c3d92e63-29b1-41bd-8b65-39783d017ba6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:38.207236 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c3d92e63-29b1-41bd-8b65-39783d017ba6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:38.213365 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c3d92e63-29b1-41bd-8b65-39783d017ba6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:38.213913 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c3d92e63-29b1-41bd-8b65-39783d017ba6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:38.214837 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c3d92e63-29b1-41bd-8b65-39783d017ba6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:38.215417 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c3d92e63-29b1-41bd-8b65-39783d017ba6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:38.272730 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] validate_networks() for [('5b53c648-0313-4179-8334-9fa5d1933987', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:09:38.324295 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c3d92e63-29b1-41bd-8b65-39783d017ba6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 17834 microversion: 2.20 time: 0.122665 Oct 27 14:09:38.329212 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 150/291] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:38 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 17834 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:09:38.355180 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0c617cd0-7d9a-44b0-ba12-a93bd5e7a17a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:38.356478 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0c617cd0-7d9a-44b0-ba12-a93bd5e7a17a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:38.364177 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0c617cd0-7d9a-44b0-ba12-a93bd5e7a17a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:38.364762 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0c617cd0-7d9a-44b0-ba12-a93bd5e7a17a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:38.365640 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0c617cd0-7d9a-44b0-ba12-a93bd5e7a17a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:38.366181 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0c617cd0-7d9a-44b0-ba12-a93bd5e7a17a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:38.471907 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0c617cd0-7d9a-44b0-ba12-a93bd5e7a17a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 25956 microversion: 2.1 time: 0.123250 Oct 27 14:09:38.473502 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 151/292] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:38 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 25956 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:38.679752 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7f46cdae-5661-486b-8d21-a9daeedd6f5b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:38.680848 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7f46cdae-5661-486b-8d21-a9daeedd6f5b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:38.696894 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7f46cdae-5661-486b-8d21-a9daeedd6f5b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:38.699082 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7f46cdae-5661-486b-8d21-a9daeedd6f5b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:38.704138 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7f46cdae-5661-486b-8d21-a9daeedd6f5b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:38.705428 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7f46cdae-5661-486b-8d21-a9daeedd6f5b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:38.924740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:09:38.925207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:09:38.925677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:09:38.926078 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:09:38.927279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:09:38.936659 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:38.937632 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:38.938446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:38.939059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:38.961612 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Getting quotas for project a55431e3db544b7980c81c6303d1e8b2. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:09:38.964536 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-7f46cdae-5661-486b-8d21-a9daeedd6f5b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:38.966229 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Getting quotas for user 3e59b470cb41474bb92d7e1049d02e6f and project a55431e3db544b7980c81c6303d1e8b2. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:09:38.972803 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7f46cdae-5661-486b-8d21-a9daeedd6f5b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.297743 Oct 27 14:09:38.973612 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 152/293] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:38 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:38.983506 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:09:38.985827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:09:39.031751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9053d5ae-0e16-4f59-8057-0e61a6838ab2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.667423 Oct 27 14:09:39.037199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 142/294] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:09:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 9669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:09:39.042703 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e43004a2-cc86-4245-83a6-54214c7d3a63 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:39.043590 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e43004a2-cc86-4245-83a6-54214c7d3a63 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:39.105882 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e43004a2-cc86-4245-83a6-54214c7d3a63 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:39.112484 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e43004a2-cc86-4245-83a6-54214c7d3a63 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1216 microversion: 2.1 time: 0.073643 Oct 27 14:09:39.113062 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 153/295] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:39 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:39.337490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7fa585af-aabd-4d36-812e-283601045692 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:39.338866 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7fa585af-aabd-4d36-812e-283601045692 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:39.346291 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fa585af-aabd-4d36-812e-283601045692 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:39.347359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fa585af-aabd-4d36-812e-283601045692 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:39.348657 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fa585af-aabd-4d36-812e-283601045692 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:39.349248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fa585af-aabd-4d36-812e-283601045692 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:39.474487 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7fa585af-aabd-4d36-812e-283601045692 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 19342 microversion: 2.20 time: 0.141712 Oct 27 14:09:39.475167 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 143/296] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:39 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 19342 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:39.494814 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d09a6d66-d5e4-4307-9f40-366232818391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:39.496243 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d09a6d66-d5e4-4307-9f40-366232818391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:39.506541 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d09a6d66-d5e4-4307-9f40-366232818391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:39.506998 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d09a6d66-d5e4-4307-9f40-366232818391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:39.507816 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d09a6d66-d5e4-4307-9f40-366232818391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:39.508256 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d09a6d66-d5e4-4307-9f40-366232818391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:39.629840 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d09a6d66-d5e4-4307-9f40-366232818391 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 26554 microversion: 2.1 time: 0.149517 Oct 27 14:09:39.630476 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 154/297] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:39 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 26554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:39.990200 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d049390e-a1a4-4c9d-99b7-91af18b2959f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:39.990800 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d049390e-a1a4-4c9d-99b7-91af18b2959f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:39.998525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d049390e-a1a4-4c9d-99b7-91af18b2959f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:39.998974 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d049390e-a1a4-4c9d-99b7-91af18b2959f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:39.999785 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d049390e-a1a4-4c9d-99b7-91af18b2959f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:40.000219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d049390e-a1a4-4c9d-99b7-91af18b2959f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:40.131055 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-84e7aab7-e9dc-456a-bb87-4bde3e5f5972 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:40.132422 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-84e7aab7-e9dc-456a-bb87-4bde3e5f5972 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:40.139225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d049390e-a1a4-4c9d-99b7-91af18b2959f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:40.140928 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-84e7aab7-e9dc-456a-bb87-4bde3e5f5972 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:40.141383 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-84e7aab7-e9dc-456a-bb87-4bde3e5f5972 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:40.142171 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-84e7aab7-e9dc-456a-bb87-4bde3e5f5972 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:40.142611 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-84e7aab7-e9dc-456a-bb87-4bde3e5f5972 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:40.148062 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d049390e-a1a4-4c9d-99b7-91af18b2959f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.161943 Oct 27 14:09:40.148654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 144/298] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:39 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:40.214105 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-84e7aab7-e9dc-456a-bb87-4bde3e5f5972 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:40.223474 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-84e7aab7-e9dc-456a-bb87-4bde3e5f5972 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1268 microversion: 2.1 time: 0.097002 Oct 27 14:09:40.224034 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 155/299] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:40 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1268 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:40.497668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-45132565-25e7-43a0-89a8-977df9f3e79e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:40.497668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-45132565-25e7-43a0-89a8-977df9f3e79e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:40.497668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45132565-25e7-43a0-89a8-977df9f3e79e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:40.498656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45132565-25e7-43a0-89a8-977df9f3e79e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:40.499390 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45132565-25e7-43a0-89a8-977df9f3e79e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:40.499911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45132565-25e7-43a0-89a8-977df9f3e79e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:40.610711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-45132565-25e7-43a0-89a8-977df9f3e79e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 20712 microversion: 2.20 time: 0.126034 Oct 27 14:09:40.611684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 145/300] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:40 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 20712 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:40.644425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-daf74c96-2d7d-4b5e-8922-86c953e99e31 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:40.646130 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-daf74c96-2d7d-4b5e-8922-86c953e99e31 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:40.655433 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-daf74c96-2d7d-4b5e-8922-86c953e99e31 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:40.655967 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-daf74c96-2d7d-4b5e-8922-86c953e99e31 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:40.656954 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-daf74c96-2d7d-4b5e-8922-86c953e99e31 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:40.657592 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-daf74c96-2d7d-4b5e-8922-86c953e99e31 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:40.769423 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-daf74c96-2d7d-4b5e-8922-86c953e99e31 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 26973 microversion: 2.1 time: 0.129886 Oct 27 14:09:40.770167 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 156/301] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:40 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 26973 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:41.166073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d7a96395-9aa7-4303-ad6a-555ca119788a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:41.167015 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d7a96395-9aa7-4303-ad6a-555ca119788a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:41.173861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7a96395-9aa7-4303-ad6a-555ca119788a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:41.174412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7a96395-9aa7-4303-ad6a-555ca119788a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:41.175420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7a96395-9aa7-4303-ad6a-555ca119788a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:41.175850 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7a96395-9aa7-4303-ad6a-555ca119788a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:41.242246 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0df22b61-ec75-4399-8e5e-e56c0948a1d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:41.242969 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0df22b61-ec75-4399-8e5e-e56c0948a1d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:41.250743 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0df22b61-ec75-4399-8e5e-e56c0948a1d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:41.251255 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0df22b61-ec75-4399-8e5e-e56c0948a1d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:41.252310 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0df22b61-ec75-4399-8e5e-e56c0948a1d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:41.252746 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0df22b61-ec75-4399-8e5e-e56c0948a1d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:41.541605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d7a96395-9aa7-4303-ad6a-555ca119788a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:41.560808 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d7a96395-9aa7-4303-ad6a-555ca119788a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.398706 Oct 27 14:09:41.562555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 146/302] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:41 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:41.588453 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-0df22b61-ec75-4399-8e5e-e56c0948a1d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:41.596690 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0df22b61-ec75-4399-8e5e-e56c0948a1d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.358819 Oct 27 14:09:41.623759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-36d22d9d-b47d-4e1e-b449-6b089f936eb2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:41.624228 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 157/303] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:41 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:41.624959 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-36d22d9d-b47d-4e1e-b449-6b089f936eb2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:41.653064 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-36d22d9d-b47d-4e1e-b449-6b089f936eb2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:41.653516 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-36d22d9d-b47d-4e1e-b449-6b089f936eb2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:41.654327 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-36d22d9d-b47d-4e1e-b449-6b089f936eb2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:41.660551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-36d22d9d-b47d-4e1e-b449-6b089f936eb2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:41.766802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-36d22d9d-b47d-4e1e-b449-6b089f936eb2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 21777 microversion: 2.20 time: 0.146618 Oct 27 14:09:41.766802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 147/304] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:41 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 21777 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:41.781402 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-57b0490c-0faa-47d4-bd78-5e4983b484c1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:41.782328 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-57b0490c-0faa-47d4-bd78-5e4983b484c1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:41.792487 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57b0490c-0faa-47d4-bd78-5e4983b484c1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:41.792926 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57b0490c-0faa-47d4-bd78-5e4983b484c1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:41.793733 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57b0490c-0faa-47d4-bd78-5e4983b484c1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:41.795118 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57b0490c-0faa-47d4-bd78-5e4983b484c1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:41.949436 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-57b0490c-0faa-47d4-bd78-5e4983b484c1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 27477 microversion: 2.1 time: 0.171674 Oct 27 14:09:41.950095 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 158/305] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:41 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 27477 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:42.256751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-d783c1fb-354f-4735-a5ca-c734446f7aa5 req-e1493cf8-d681-4088-9480-ca2e2d18efa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d21e2b-a722-4824-b404-e0493b36c4d1", "tag": "068771a3-6b8e-4d3f-9708-0f828f723d7d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:42.258601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:42.258601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:09:42.269875 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-d783c1fb-354f-4735-a5ca-c734446f7aa5 req-e1493cf8-d681-4088-9480-ca2e2d18efa2 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:42.270228 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-d783c1fb-354f-4735-a5ca-c734446f7aa5 req-e1493cf8-d681-4088-9480-ca2e2d18efa2 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:42.300401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-d783c1fb-354f-4735-a5ca-c734446f7aa5 req-e1493cf8-d681-4088-9480-ca2e2d18efa2 service nova] Creating event network-changed:068771a3-6b8e-4d3f-9708-0f828f723d7d for instance 33d21e2b-a722-4824-b404-e0493b36c4d1 on hv-cinder-81566 Oct 27 14:09:42.315166 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-d783c1fb-354f-4735-a5ca-c734446f7aa5 req-e1493cf8-d681-4088-9480-ca2e2d18efa2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062580 Oct 27 14:09:42.318806 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 148/306] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:42.579629 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4cbc894e-d619-4453-82bf-f90c0fd03fa0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:42.580864 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4cbc894e-d619-4453-82bf-f90c0fd03fa0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:42.588788 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4cbc894e-d619-4453-82bf-f90c0fd03fa0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:42.589628 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4cbc894e-d619-4453-82bf-f90c0fd03fa0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:42.591827 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4cbc894e-d619-4453-82bf-f90c0fd03fa0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:42.592886 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4cbc894e-d619-4453-82bf-f90c0fd03fa0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:42.617447 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3980f398-6574-4fb6-8faf-98f35c49a384 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:42.618142 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3980f398-6574-4fb6-8faf-98f35c49a384 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:42.624664 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3980f398-6574-4fb6-8faf-98f35c49a384 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:42.625120 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3980f398-6574-4fb6-8faf-98f35c49a384 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:42.625997 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3980f398-6574-4fb6-8faf-98f35c49a384 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:42.626609 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3980f398-6574-4fb6-8faf-98f35c49a384 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:42.898149 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4cbc894e-d619-4453-82bf-f90c0fd03fa0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:42.906327 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4cbc894e-d619-4453-82bf-f90c0fd03fa0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.331410 Oct 27 14:09:42.912903 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 159/307] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:42 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:42.924278 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b5e39c46-4ff8-4946-817d-05d543c95dae tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:42.925308 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-b5e39c46-4ff8-4946-817d-05d543c95dae tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:42.931802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3980f398-6574-4fb6-8faf-98f35c49a384 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:42.934990 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b5e39c46-4ff8-4946-817d-05d543c95dae tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:42.935376 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b5e39c46-4ff8-4946-817d-05d543c95dae tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:42.936157 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b5e39c46-4ff8-4946-817d-05d543c95dae tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:42.936586 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b5e39c46-4ff8-4946-817d-05d543c95dae tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:42.953944 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3980f398-6574-4fb6-8faf-98f35c49a384 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.342410 Oct 27 14:09:42.955579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 149/308] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:42 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:42.973496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-da707f1e-e144-4c19-986d-37191d903423 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:42.980048 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-da707f1e-e144-4c19-986d-37191d903423 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:43.004897 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da707f1e-e144-4c19-986d-37191d903423 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:43.005420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da707f1e-e144-4c19-986d-37191d903423 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:43.006283 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da707f1e-e144-4c19-986d-37191d903423 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:43.006782 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da707f1e-e144-4c19-986d-37191d903423 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:43.110750 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b5e39c46-4ff8-4946-817d-05d543c95dae tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 23016 microversion: 2.20 time: 0.195621 Oct 27 14:09:43.111646 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 160/309] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:42 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 23016 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:43.168481 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-da707f1e-e144-4c19-986d-37191d903423 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 27704 microversion: 2.1 time: 0.206635 Oct 27 14:09:43.170248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 150/310] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:42 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 27704 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:43.930289 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-91d6909e-5e6c-4100-a3e5-265ca9f1088a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:43.931061 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-91d6909e-5e6c-4100-a3e5-265ca9f1088a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:43.939195 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-91d6909e-5e6c-4100-a3e5-265ca9f1088a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:43.939719 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-91d6909e-5e6c-4100-a3e5-265ca9f1088a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:43.940579 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-91d6909e-5e6c-4100-a3e5-265ca9f1088a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:43.944590 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-91d6909e-5e6c-4100-a3e5-265ca9f1088a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:43.971378 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-25905371-0451-4767-8c19-d9be41bac61a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:43.972307 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-25905371-0451-4767-8c19-d9be41bac61a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:43.979830 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25905371-0451-4767-8c19-d9be41bac61a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:43.980393 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25905371-0451-4767-8c19-d9be41bac61a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:43.981268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25905371-0451-4767-8c19-d9be41bac61a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:43.982298 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25905371-0451-4767-8c19-d9be41bac61a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:44.141518 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-91d6909e-5e6c-4100-a3e5-265ca9f1088a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:44.151935 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-91d6909e-5e6c-4100-a3e5-265ca9f1088a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.225619 Oct 27 14:09:44.152794 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 161/311] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:43 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:44.159234 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-25905371-0451-4767-8c19-d9be41bac61a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:44.159532 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-3c4ad62d-baa9-49fc-8f63-796489354952 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:44.160599 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-3c4ad62d-baa9-49fc-8f63-796489354952 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:44.167719 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3c4ad62d-baa9-49fc-8f63-796489354952 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:44.168164 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3c4ad62d-baa9-49fc-8f63-796489354952 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:44.169102 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-25905371-0451-4767-8c19-d9be41bac61a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.202291 Oct 27 14:09:44.169266 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3c4ad62d-baa9-49fc-8f63-796489354952 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:44.169585 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3c4ad62d-baa9-49fc-8f63-796489354952 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:44.170334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 151/312] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:43 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:44.182348 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ea01e5e6-641b-4c81-a4dd-ae9defb901cf tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:44.184130 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ea01e5e6-641b-4c81-a4dd-ae9defb901cf tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:44.195280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ea01e5e6-641b-4c81-a4dd-ae9defb901cf tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:44.196326 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ea01e5e6-641b-4c81-a4dd-ae9defb901cf tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:44.197391 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ea01e5e6-641b-4c81-a4dd-ae9defb901cf tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:44.197981 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ea01e5e6-641b-4c81-a4dd-ae9defb901cf tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:44.302344 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-3c4ad62d-baa9-49fc-8f63-796489354952 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 23784 microversion: 2.20 time: 0.147513 Oct 27 14:09:44.303952 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 162/313] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:44 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 23784 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:44.355174 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ea01e5e6-641b-4c81-a4dd-ae9defb901cf tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 27888 microversion: 2.1 time: 0.176205 Oct 27 14:09:44.356091 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 152/314] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:44 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 27888 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:45.170153 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-9a01ea80-857a-4635-a663-d4a9cf46c08a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:45.170878 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-9a01ea80-857a-4635-a663-d4a9cf46c08a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:45.177787 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9a01ea80-857a-4635-a663-d4a9cf46c08a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:45.178237 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9a01ea80-857a-4635-a663-d4a9cf46c08a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:45.179009 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9a01ea80-857a-4635-a663-d4a9cf46c08a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:45.179483 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9a01ea80-857a-4635-a663-d4a9cf46c08a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:45.188016 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ee57e892-5346-4e88-b0af-f66093e23480 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:45.188712 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ee57e892-5346-4e88-b0af-f66093e23480 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:45.195930 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ee57e892-5346-4e88-b0af-f66093e23480 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:45.196372 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ee57e892-5346-4e88-b0af-f66093e23480 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:45.197144 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ee57e892-5346-4e88-b0af-f66093e23480 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:45.197577 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ee57e892-5346-4e88-b0af-f66093e23480 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:45.367942 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-9a01ea80-857a-4635-a663-d4a9cf46c08a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:45.384117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ee57e892-5346-4e88-b0af-f66093e23480 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:45.384294 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-9a01ea80-857a-4635-a663-d4a9cf46c08a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.212934 Oct 27 14:09:45.386383 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 163/315] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:45 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:45.390914 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8a796cc6-35df-4489-baf5-35f775f42c47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:45.392127 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-8a796cc6-35df-4489-baf5-35f775f42c47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:45.392609 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ee57e892-5346-4e88-b0af-f66093e23480 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.209462 Oct 27 14:09:45.393634 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 153/316] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:45 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:45.398981 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8a796cc6-35df-4489-baf5-35f775f42c47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:45.399573 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8a796cc6-35df-4489-baf5-35f775f42c47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:45.400494 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8a796cc6-35df-4489-baf5-35f775f42c47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:45.400934 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8a796cc6-35df-4489-baf5-35f775f42c47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:45.405375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b5d33951-8040-40bb-97c7-f45df456ac59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:45.406286 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b5d33951-8040-40bb-97c7-f45df456ac59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:45.412262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b5d33951-8040-40bb-97c7-f45df456ac59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:45.412698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b5d33951-8040-40bb-97c7-f45df456ac59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:45.413461 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b5d33951-8040-40bb-97c7-f45df456ac59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:45.413945 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b5d33951-8040-40bb-97c7-f45df456ac59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:45.501349 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-8a796cc6-35df-4489-baf5-35f775f42c47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 24606 microversion: 2.20 time: 0.115069 Oct 27 14:09:45.502459 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 164/317] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:45 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 24606 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:45.561868 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b5d33951-8040-40bb-97c7-f45df456ac59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28091 microversion: 2.1 time: 0.166645 Oct 27 14:09:45.562525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 154/318] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:45 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28091 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:46.406843 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-dbda5359-3857-49f7-b141-9a6a8d535399 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:46.408604 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-dbda5359-3857-49f7-b141-9a6a8d535399 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:46.412237 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-58cb447f-cd71-447b-998c-4f8a25fddbd3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:46.413047 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-58cb447f-cd71-447b-998c-4f8a25fddbd3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:46.415994 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dbda5359-3857-49f7-b141-9a6a8d535399 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:46.416452 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dbda5359-3857-49f7-b141-9a6a8d535399 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:46.417239 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dbda5359-3857-49f7-b141-9a6a8d535399 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:46.417699 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dbda5359-3857-49f7-b141-9a6a8d535399 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:46.421225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58cb447f-cd71-447b-998c-4f8a25fddbd3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:46.421958 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58cb447f-cd71-447b-998c-4f8a25fddbd3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:46.422755 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58cb447f-cd71-447b-998c-4f8a25fddbd3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:46.423303 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58cb447f-cd71-447b-998c-4f8a25fddbd3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:46.600643 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-dbda5359-3857-49f7-b141-9a6a8d535399 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:46.602961 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-58cb447f-cd71-447b-998c-4f8a25fddbd3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:46.608533 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-dbda5359-3857-49f7-b141-9a6a8d535399 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.207527 Oct 27 14:09:46.609109 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 165/319] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:46 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:46.610721 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-58cb447f-cd71-447b-998c-4f8a25fddbd3 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.204921 Oct 27 14:09:46.614150 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-3b33936c-2dfc-46a1-a449-42ebc6e5c718 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:46.615063 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-3b33936c-2dfc-46a1-a449-42ebc6e5c718 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:46.621315 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3b33936c-2dfc-46a1-a449-42ebc6e5c718 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:46.621765 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3b33936c-2dfc-46a1-a449-42ebc6e5c718 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:46.621902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 155/320] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:46 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:46.622757 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3b33936c-2dfc-46a1-a449-42ebc6e5c718 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:46.623253 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3b33936c-2dfc-46a1-a449-42ebc6e5c718 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:46.627734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5a61680a-e935-432e-8521-89dfea942a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:46.628666 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5a61680a-e935-432e-8521-89dfea942a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:46.634931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5a61680a-e935-432e-8521-89dfea942a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:46.635410 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5a61680a-e935-432e-8521-89dfea942a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:46.636197 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5a61680a-e935-432e-8521-89dfea942a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:46.636631 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5a61680a-e935-432e-8521-89dfea942a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:49.623361 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-3b33936c-2dfc-46a1-a449-42ebc6e5c718 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 26408 microversion: 2.20 time: 3.012708 Oct 27 14:09:49.624048 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 166/321] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:46 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 26408 bytes in 3014 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:49.631091 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ff3cd13d-66dc-4012-8277-78ac11290daf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:49.631819 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ff3cd13d-66dc-4012-8277-78ac11290daf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:49.639310 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ff3cd13d-66dc-4012-8277-78ac11290daf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:49.639762 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ff3cd13d-66dc-4012-8277-78ac11290daf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:49.640575 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ff3cd13d-66dc-4012-8277-78ac11290daf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:49.641013 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ff3cd13d-66dc-4012-8277-78ac11290daf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:49.647427 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5a61680a-e935-432e-8521-89dfea942a65 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28183 microversion: 2.1 time: 3.022797 Oct 27 14:09:49.647427 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 156/322] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:46 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28183 bytes in 3024 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:49.653029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f6b77f10-bb82-48d3-868e-e915823512ff tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:49.654359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f6b77f10-bb82-48d3-868e-e915823512ff tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:49.661641 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f6b77f10-bb82-48d3-868e-e915823512ff tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:49.662135 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f6b77f10-bb82-48d3-868e-e915823512ff tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:49.662971 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f6b77f10-bb82-48d3-868e-e915823512ff tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:49.663505 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f6b77f10-bb82-48d3-868e-e915823512ff tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:49.822459 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ff3cd13d-66dc-4012-8277-78ac11290daf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:49.830772 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ff3cd13d-66dc-4012-8277-78ac11290daf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.205566 Oct 27 14:09:49.831409 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 167/323] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:49 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:49.841427 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f6b77f10-bb82-48d3-868e-e915823512ff tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:49.848735 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f6b77f10-bb82-48d3-868e-e915823512ff tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.200120 Oct 27 14:09:49.849321 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 157/324] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:49 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:50.635525 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7bc4678f-4a44-4b2b-9677-91c97db892ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:50.636441 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7bc4678f-4a44-4b2b-9677-91c97db892ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:50.643559 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7bc4678f-4a44-4b2b-9677-91c97db892ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:50.644009 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7bc4678f-4a44-4b2b-9677-91c97db892ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:50.644784 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7bc4678f-4a44-4b2b-9677-91c97db892ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:50.645224 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7bc4678f-4a44-4b2b-9677-91c97db892ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:50.658587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-11b30d40-f84f-4d64-ae5a-dcaf82b4dbea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:50.660209 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-11b30d40-f84f-4d64-ae5a-dcaf82b4dbea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:50.666973 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11b30d40-f84f-4d64-ae5a-dcaf82b4dbea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:50.667455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11b30d40-f84f-4d64-ae5a-dcaf82b4dbea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:50.668243 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11b30d40-f84f-4d64-ae5a-dcaf82b4dbea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:50.668675 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11b30d40-f84f-4d64-ae5a-dcaf82b4dbea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:50.753831 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7bc4678f-4a44-4b2b-9677-91c97db892ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 26907 microversion: 2.20 time: 0.121739 Oct 27 14:09:50.755064 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 168/325] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:50 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 26907 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:50.759314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-11b30d40-f84f-4d64-ae5a-dcaf82b4dbea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28183 microversion: 2.1 time: 0.104633 Oct 27 14:09:50.760132 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 158/326] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:50 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:09:50.847489 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-81fd3aa4-b323-414b-bcce-1e6d642ff038 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:50.848173 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-81fd3aa4-b323-414b-bcce-1e6d642ff038 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:50.854915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-81fd3aa4-b323-414b-bcce-1e6d642ff038 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:50.855688 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-81fd3aa4-b323-414b-bcce-1e6d642ff038 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:50.857363 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-81fd3aa4-b323-414b-bcce-1e6d642ff038 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:50.857942 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-81fd3aa4-b323-414b-bcce-1e6d642ff038 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:50.866097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5f594a27-382a-4d7e-9223-fa5d030f3bbb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:50.866937 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5f594a27-382a-4d7e-9223-fa5d030f3bbb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:50.874461 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f594a27-382a-4d7e-9223-fa5d030f3bbb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:50.874914 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f594a27-382a-4d7e-9223-fa5d030f3bbb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:50.875712 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f594a27-382a-4d7e-9223-fa5d030f3bbb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:50.876445 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f594a27-382a-4d7e-9223-fa5d030f3bbb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:51.059213 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-81fd3aa4-b323-414b-bcce-1e6d642ff038 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:51.069441 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-81fd3aa4-b323-414b-bcce-1e6d642ff038 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.225653 Oct 27 14:09:51.071925 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 169/327] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:50 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:51.073382 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5f594a27-382a-4d7e-9223-fa5d030f3bbb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:51.081849 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5f594a27-382a-4d7e-9223-fa5d030f3bbb tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.219814 Oct 27 14:09:51.082421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 159/328] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:50 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:51.766611 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0b2e8850-c5f7-40ea-96c2-32f103d8b08c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:51.767567 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0b2e8850-c5f7-40ea-96c2-32f103d8b08c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:51.770871 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-600a6512-d53f-49ec-a170-5820debab82d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:51.771837 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-600a6512-d53f-49ec-a170-5820debab82d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:51.773844 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0b2e8850-c5f7-40ea-96c2-32f103d8b08c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:51.774296 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0b2e8850-c5f7-40ea-96c2-32f103d8b08c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:51.775066 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0b2e8850-c5f7-40ea-96c2-32f103d8b08c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:51.775541 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0b2e8850-c5f7-40ea-96c2-32f103d8b08c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:51.779422 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-600a6512-d53f-49ec-a170-5820debab82d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:51.779873 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-600a6512-d53f-49ec-a170-5820debab82d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:51.780938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-600a6512-d53f-49ec-a170-5820debab82d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:51.781379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-600a6512-d53f-49ec-a170-5820debab82d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:51.920094 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0b2e8850-c5f7-40ea-96c2-32f103d8b08c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 27236 microversion: 2.20 time: 0.157673 Oct 27 14:09:51.920661 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 170/329] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:51 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 27236 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:09:51.940830 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-600a6512-d53f-49ec-a170-5820debab82d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28183 microversion: 2.1 time: 0.173414 Oct 27 14:09:51.941456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 160/330] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:51 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:09:52.088438 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-3cf81648-a41d-4728-93ac-981652af7070 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:52.089122 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-3cf81648-a41d-4728-93ac-981652af7070 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:52.097173 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3cf81648-a41d-4728-93ac-981652af7070 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:52.097525 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3cf81648-a41d-4728-93ac-981652af7070 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:52.098296 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3cf81648-a41d-4728-93ac-981652af7070 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:52.098723 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3cf81648-a41d-4728-93ac-981652af7070 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:52.100777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-93b33d40-f5fe-4a56-b9bf-913e4aae5faa tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:52.101643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-93b33d40-f5fe-4a56-b9bf-913e4aae5faa tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:52.110424 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-93b33d40-f5fe-4a56-b9bf-913e4aae5faa tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:52.111372 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-93b33d40-f5fe-4a56-b9bf-913e4aae5faa tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:52.114018 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-93b33d40-f5fe-4a56-b9bf-913e4aae5faa tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:52.114667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-93b33d40-f5fe-4a56-b9bf-913e4aae5faa tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:52.307798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-93b33d40-f5fe-4a56-b9bf-913e4aae5faa tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:52.315094 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-3cf81648-a41d-4728-93ac-981652af7070 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:52.315298 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-93b33d40-f5fe-4a56-b9bf-913e4aae5faa tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.219467 Oct 27 14:09:52.315984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 161/331] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:52 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:52.322797 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-3cf81648-a41d-4728-93ac-981652af7070 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.238296 Oct 27 14:09:52.323376 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 171/332] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:52 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:52.931549 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0d8ed51b-c15b-40b5-8587-a0e68c86774b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:52.932479 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0d8ed51b-c15b-40b5-8587-a0e68c86774b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:52.939463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d8ed51b-c15b-40b5-8587-a0e68c86774b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:52.939911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d8ed51b-c15b-40b5-8587-a0e68c86774b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:52.940676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d8ed51b-c15b-40b5-8587-a0e68c86774b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:52.941110 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d8ed51b-c15b-40b5-8587-a0e68c86774b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:52.952849 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2521c647-5d97-4ae6-833a-73a453548e43 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:52.953760 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2521c647-5d97-4ae6-833a-73a453548e43 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:52.959783 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2521c647-5d97-4ae6-833a-73a453548e43 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:52.960231 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2521c647-5d97-4ae6-833a-73a453548e43 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:52.961011 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2521c647-5d97-4ae6-833a-73a453548e43 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:52.961449 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2521c647-5d97-4ae6-833a-73a453548e43 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:53.036020 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0d8ed51b-c15b-40b5-8587-a0e68c86774b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 27637 microversion: 2.20 time: 0.108668 Oct 27 14:09:53.036676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 162/333] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:52 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 27637 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:53.063961 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2521c647-5d97-4ae6-833a-73a453548e43 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28183 microversion: 2.1 time: 0.115196 Oct 27 14:09:53.067920 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 172/334] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:52 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:09:53.333861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9771282b-f2e0-4bc1-8aac-2f09bcd56524 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:53.334545 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9771282b-f2e0-4bc1-8aac-2f09bcd56524 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:53.342822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9771282b-f2e0-4bc1-8aac-2f09bcd56524 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:53.343502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9771282b-f2e0-4bc1-8aac-2f09bcd56524 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:53.344201 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-370e8999-37ef-4d23-98d7-0de1f7f1fdf0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:53.344749 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9771282b-f2e0-4bc1-8aac-2f09bcd56524 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:53.345140 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-370e8999-37ef-4d23-98d7-0de1f7f1fdf0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:53.345335 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9771282b-f2e0-4bc1-8aac-2f09bcd56524 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:53.353690 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-370e8999-37ef-4d23-98d7-0de1f7f1fdf0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:53.354198 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-370e8999-37ef-4d23-98d7-0de1f7f1fdf0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:53.355008 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-370e8999-37ef-4d23-98d7-0de1f7f1fdf0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:53.355474 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-370e8999-37ef-4d23-98d7-0de1f7f1fdf0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:53.556733 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9771282b-f2e0-4bc1-8aac-2f09bcd56524 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:53.560617 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-370e8999-37ef-4d23-98d7-0de1f7f1fdf0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:53.568166 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9771282b-f2e0-4bc1-8aac-2f09bcd56524 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.238390 Oct 27 14:09:53.569391 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-370e8999-37ef-4d23-98d7-0de1f7f1fdf0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.230675 Oct 27 14:09:53.570191 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 173/335] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:53 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:53.579395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 163/336] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:53 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:54.050226 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4b37338d-ffcb-40d5-b011-2ee7edeaa1f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:54.051314 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4b37338d-ffcb-40d5-b011-2ee7edeaa1f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:54.057543 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4b37338d-ffcb-40d5-b011-2ee7edeaa1f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:54.057985 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4b37338d-ffcb-40d5-b011-2ee7edeaa1f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:54.058761 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4b37338d-ffcb-40d5-b011-2ee7edeaa1f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:54.059505 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4b37338d-ffcb-40d5-b011-2ee7edeaa1f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:54.075573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b72ad309-1b8e-4b2a-acf4-52732a06c9e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:54.077242 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b72ad309-1b8e-4b2a-acf4-52732a06c9e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:54.084516 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b72ad309-1b8e-4b2a-acf4-52732a06c9e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:54.084965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b72ad309-1b8e-4b2a-acf4-52732a06c9e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:54.087330 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b72ad309-1b8e-4b2a-acf4-52732a06c9e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:54.088091 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b72ad309-1b8e-4b2a-acf4-52732a06c9e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:54.230782 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4b37338d-ffcb-40d5-b011-2ee7edeaa1f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 27811 microversion: 2.20 time: 0.186525 Oct 27 14:09:54.232019 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 174/337] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:54 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 27811 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:54.280089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b72ad309-1b8e-4b2a-acf4-52732a06c9e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28295 microversion: 2.1 time: 0.208090 Oct 27 14:09:54.283982 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 164/338] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:54 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28295 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:09:54.586440 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-494b6047-f2ea-40a7-83c5-0e52d748e9a5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:54.587106 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-163d7617-68fe-4994-b434-5197bf052477 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:54.587262 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-494b6047-f2ea-40a7-83c5-0e52d748e9a5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:54.587827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-163d7617-68fe-4994-b434-5197bf052477 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:54.595095 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-494b6047-f2ea-40a7-83c5-0e52d748e9a5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:54.595784 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-494b6047-f2ea-40a7-83c5-0e52d748e9a5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:54.595908 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-163d7617-68fe-4994-b434-5197bf052477 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:54.596302 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-163d7617-68fe-4994-b434-5197bf052477 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:54.596568 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-494b6047-f2ea-40a7-83c5-0e52d748e9a5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:54.596996 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-494b6047-f2ea-40a7-83c5-0e52d748e9a5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:54.597236 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-163d7617-68fe-4994-b434-5197bf052477 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:54.597671 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-163d7617-68fe-4994-b434-5197bf052477 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:54.792267 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-163d7617-68fe-4994-b434-5197bf052477 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:54.796360 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-494b6047-f2ea-40a7-83c5-0e52d748e9a5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:54.801356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-163d7617-68fe-4994-b434-5197bf052477 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.218118 Oct 27 14:09:54.802017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 165/339] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:54 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:54.803747 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-494b6047-f2ea-40a7-83c5-0e52d748e9a5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.221605 Oct 27 14:09:54.804305 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 175/340] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:54 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:55.244598 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9f946929-3d3c-4ae5-a711-adcd0261dcf8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:55.245513 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9f946929-3d3c-4ae5-a711-adcd0261dcf8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:55.254046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9f946929-3d3c-4ae5-a711-adcd0261dcf8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:55.254416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9f946929-3d3c-4ae5-a711-adcd0261dcf8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:55.255225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9f946929-3d3c-4ae5-a711-adcd0261dcf8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:55.255661 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9f946929-3d3c-4ae5-a711-adcd0261dcf8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:55.291825 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-dd63348c-8950-449a-822d-053376748d78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:55.293306 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-dd63348c-8950-449a-822d-053376748d78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:55.301953 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dd63348c-8950-449a-822d-053376748d78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:55.302688 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dd63348c-8950-449a-822d-053376748d78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:55.304148 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dd63348c-8950-449a-822d-053376748d78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:55.304663 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dd63348c-8950-449a-822d-053376748d78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:55.391240 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9f946929-3d3c-4ae5-a711-adcd0261dcf8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 27869 microversion: 2.20 time: 0.150665 Oct 27 14:09:55.392469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 166/341] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:55 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 27869 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:09:55.437642 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-dd63348c-8950-449a-822d-053376748d78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28470 microversion: 2.1 time: 0.149561 Oct 27 14:09:55.438665 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 176/342] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:55 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:09:55.818990 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f2ed3dec-1fca-44d0-a6be-086dde5adf2b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:55.819726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f2ed3dec-1fca-44d0-a6be-086dde5adf2b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:55.821392 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-855ed08d-716f-443d-b954-d37df309685c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:55.822146 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-855ed08d-716f-443d-b954-d37df309685c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:55.828087 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2ed3dec-1fca-44d0-a6be-086dde5adf2b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:55.828625 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2ed3dec-1fca-44d0-a6be-086dde5adf2b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:55.829883 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2ed3dec-1fca-44d0-a6be-086dde5adf2b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:55.830090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2ed3dec-1fca-44d0-a6be-086dde5adf2b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:55.837576 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-855ed08d-716f-443d-b954-d37df309685c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:55.838117 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-855ed08d-716f-443d-b954-d37df309685c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:55.839487 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-855ed08d-716f-443d-b954-d37df309685c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:55.840045 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-855ed08d-716f-443d-b954-d37df309685c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:56.020092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f2ed3dec-1fca-44d0-a6be-086dde5adf2b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:56.024484 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-855ed08d-716f-443d-b954-d37df309685c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:56.027948 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f2ed3dec-1fca-44d0-a6be-086dde5adf2b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.213830 Oct 27 14:09:56.029278 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 167/343] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:55 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:56.033552 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-855ed08d-716f-443d-b954-d37df309685c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.216780 Oct 27 14:09:56.034123 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 177/344] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:55 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:56.403328 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1371c78f-d690-4ab1-a378-66497a7e3f8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:56.405065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1371c78f-d690-4ab1-a378-66497a7e3f8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:56.415046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1371c78f-d690-4ab1-a378-66497a7e3f8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:56.415803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1371c78f-d690-4ab1-a378-66497a7e3f8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:56.416904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1371c78f-d690-4ab1-a378-66497a7e3f8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:56.417504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1371c78f-d690-4ab1-a378-66497a7e3f8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:56.454515 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1c293271-438e-4aaa-95d9-d838743877e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:56.455510 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1c293271-438e-4aaa-95d9-d838743877e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:56.468327 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c293271-438e-4aaa-95d9-d838743877e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:56.469124 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c293271-438e-4aaa-95d9-d838743877e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:56.470000 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c293271-438e-4aaa-95d9-d838743877e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:56.470298 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c293271-438e-4aaa-95d9-d838743877e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:56.951490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1371c78f-d690-4ab1-a378-66497a7e3f8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28033 microversion: 2.20 time: 0.551078 Oct 27 14:09:56.952203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 168/345] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:56 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28033 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:56.956317 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1c293271-438e-4aaa-95d9-d838743877e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28470 microversion: 2.1 time: 0.506189 Oct 27 14:09:56.957219 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 178/346] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:56 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28470 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:57.046399 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c1f300f1-e885-4589-a559-ce288254ca4b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:57.047244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c1f300f1-e885-4589-a559-ce288254ca4b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:57.050213 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-9fbdbc9b-37a2-43b0-8eed-f07847bf99c8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:57.050923 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-9fbdbc9b-37a2-43b0-8eed-f07847bf99c8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:57.054500 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1f300f1-e885-4589-a559-ce288254ca4b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:57.055192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1f300f1-e885-4589-a559-ce288254ca4b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:57.055979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1f300f1-e885-4589-a559-ce288254ca4b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:57.056416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1f300f1-e885-4589-a559-ce288254ca4b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:57.058157 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9fbdbc9b-37a2-43b0-8eed-f07847bf99c8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:57.058636 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9fbdbc9b-37a2-43b0-8eed-f07847bf99c8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:57.061075 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9fbdbc9b-37a2-43b0-8eed-f07847bf99c8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:57.061718 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9fbdbc9b-37a2-43b0-8eed-f07847bf99c8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:57.266688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c1f300f1-e885-4589-a559-ce288254ca4b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:57.274755 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c1f300f1-e885-4589-a559-ce288254ca4b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.232676 Oct 27 14:09:57.276403 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-9fbdbc9b-37a2-43b0-8eed-f07847bf99c8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:57.285256 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 169/347] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:57 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:57.290877 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-9fbdbc9b-37a2-43b0-8eed-f07847bf99c8 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.244599 Oct 27 14:09:57.291662 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 179/348] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:57 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:57.963523 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-56db9030-6aaa-4d13-89e5-06ae2715c18e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:57.964528 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-56db9030-6aaa-4d13-89e5-06ae2715c18e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:57.967969 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-17a3f709-3e66-4b5b-92d7-17872db0d46b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:57.969153 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-17a3f709-3e66-4b5b-92d7-17872db0d46b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:57.972082 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-56db9030-6aaa-4d13-89e5-06ae2715c18e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:57.972790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-56db9030-6aaa-4d13-89e5-06ae2715c18e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:57.973575 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-56db9030-6aaa-4d13-89e5-06ae2715c18e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:57.974009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-56db9030-6aaa-4d13-89e5-06ae2715c18e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:57.978801 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17a3f709-3e66-4b5b-92d7-17872db0d46b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:57.979288 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17a3f709-3e66-4b5b-92d7-17872db0d46b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:57.980075 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17a3f709-3e66-4b5b-92d7-17872db0d46b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:57.980515 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-17a3f709-3e66-4b5b-92d7-17872db0d46b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:58.126056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-56db9030-6aaa-4d13-89e5-06ae2715c18e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28172 microversion: 2.20 time: 0.166222 Oct 27 14:09:58.126705 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 170/349] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:57 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28172 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:58.175653 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-17a3f709-3e66-4b5b-92d7-17872db0d46b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.211666 Oct 27 14:09:58.176338 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 180/350] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:57 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:09:58.293386 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-262afcc0-38f5-49df-809f-2a41f2fa50b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:58.294123 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-262afcc0-38f5-49df-809f-2a41f2fa50b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:58.301827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-262afcc0-38f5-49df-809f-2a41f2fa50b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:58.302276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-262afcc0-38f5-49df-809f-2a41f2fa50b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:58.303052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-262afcc0-38f5-49df-809f-2a41f2fa50b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:58.303667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-262afcc0-38f5-49df-809f-2a41f2fa50b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:58.310122 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d76919dc-6ba2-4e43-a7d5-efa99b48c8ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:58.311389 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d76919dc-6ba2-4e43-a7d5-efa99b48c8ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:58.319074 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d76919dc-6ba2-4e43-a7d5-efa99b48c8ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:58.319690 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d76919dc-6ba2-4e43-a7d5-efa99b48c8ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:58.320647 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d76919dc-6ba2-4e43-a7d5-efa99b48c8ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:58.321498 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d76919dc-6ba2-4e43-a7d5-efa99b48c8ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:58.493204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-262afcc0-38f5-49df-809f-2a41f2fa50b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:58.502357 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-262afcc0-38f5-49df-809f-2a41f2fa50b9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1520 microversion: 2.1 time: 0.213153 Oct 27 14:09:58.511825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 171/351] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:58 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:58.541478 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-d76919dc-6ba2-4e43-a7d5-efa99b48c8ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:58.552857 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d76919dc-6ba2-4e43-a7d5-efa99b48c8ef tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.247023 Oct 27 14:09:58.553475 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 181/352] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:58 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:59.142671 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7f8c6af4-2b4d-4d12-a0fc-2394d283093d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:59.143491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7f8c6af4-2b4d-4d12-a0fc-2394d283093d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:59.151156 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7f8c6af4-2b4d-4d12-a0fc-2394d283093d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.151619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7f8c6af4-2b4d-4d12-a0fc-2394d283093d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.152396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7f8c6af4-2b4d-4d12-a0fc-2394d283093d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.152829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7f8c6af4-2b4d-4d12-a0fc-2394d283093d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.192813 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-700428b6-ea55-4901-ad24-32f3dd2ed587 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:59.193915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-700428b6-ea55-4901-ad24-32f3dd2ed587 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:59.200971 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-700428b6-ea55-4901-ad24-32f3dd2ed587 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.201751 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-700428b6-ea55-4901-ad24-32f3dd2ed587 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.202400 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-700428b6-ea55-4901-ad24-32f3dd2ed587 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.202832 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-700428b6-ea55-4901-ad24-32f3dd2ed587 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.270128 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7f8c6af4-2b4d-4d12-a0fc-2394d283093d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28172 microversion: 2.20 time: 0.135992 Oct 27 14:09:59.271051 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 172/353] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:09:59 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28172 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:09:59.296811 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-700428b6-ea55-4901-ad24-32f3dd2ed587 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.110579 Oct 27 14:09:59.297465 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 182/354] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:09:59 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:09:59.532051 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3323b574-aedc-4e5c-b0ff-a14461de3225 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:59.533111 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3323b574-aedc-4e5c-b0ff-a14461de3225 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:59.541148 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3323b574-aedc-4e5c-b0ff-a14461de3225 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.541809 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3323b574-aedc-4e5c-b0ff-a14461de3225 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.542597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3323b574-aedc-4e5c-b0ff-a14461de3225 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.543035 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3323b574-aedc-4e5c-b0ff-a14461de3225 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.570820 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1e9422a6-bf31-42ff-93b2-3e9fd6d40ae1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:59.571910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1e9422a6-bf31-42ff-93b2-3e9fd6d40ae1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:59.581301 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e9422a6-bf31-42ff-93b2-3e9fd6d40ae1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.582305 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e9422a6-bf31-42ff-93b2-3e9fd6d40ae1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.583640 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e9422a6-bf31-42ff-93b2-3e9fd6d40ae1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.584516 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e9422a6-bf31-42ff-93b2-3e9fd6d40ae1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.728811 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3323b574-aedc-4e5c-b0ff-a14461de3225 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:59.737179 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3323b574-aedc-4e5c-b0ff-a14461de3225 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1500 microversion: 2.1 time: 0.219017 Oct 27 14:09:59.737996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 173/355] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:59 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1500 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:09:59.753944 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-13283727-ed41-4a19-99cc-6184d581cc22 req-5bdbd9cb-1764-489d-8a27-0972ef5a891c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d21e2b-a722-4824-b404-e0493b36c4d1", "name": "network-vif-plugged", "status": "completed", "tag": "068771a3-6b8e-4d3f-9708-0f828f723d7d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:09:59.755643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:09:59.755643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:09:59.762687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-13283727-ed41-4a19-99cc-6184d581cc22 req-5bdbd9cb-1764-489d-8a27-0972ef5a891c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.763988 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-13283727-ed41-4a19-99cc-6184d581cc22 req-5bdbd9cb-1764-489d-8a27-0972ef5a891c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.796795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-13283727-ed41-4a19-99cc-6184d581cc22 req-5bdbd9cb-1764-489d-8a27-0972ef5a891c service nova] Creating event network-vif-plugged:068771a3-6b8e-4d3f-9708-0f828f723d7d for instance 33d21e2b-a722-4824-b404-e0493b36c4d1 on hv-cinder-81566 Oct 27 14:09:59.800952 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1e9422a6-bf31-42ff-93b2-3e9fd6d40ae1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:59.805738 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-13283727-ed41-4a19-99cc-6184d581cc22 req-5bdbd9cb-1764-489d-8a27-0972ef5a891c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057795 Oct 27 14:09:59.808302 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 174/356] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:09:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:09:59.811093 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1e9422a6-bf31-42ff-93b2-3e9fd6d40ae1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.244881 Oct 27 14:09:59.815748 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-34abcb1a-6802-4259-9a09-3357a7356309 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:09:59.822694 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 183/357] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:59 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:09:59.828034 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-34abcb1a-6802-4259-9a09-3357a7356309 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:09:59.837062 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34abcb1a-6802-4259-9a09-3357a7356309 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.837513 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34abcb1a-6802-4259-9a09-3357a7356309 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.838368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34abcb1a-6802-4259-9a09-3357a7356309 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:09:59.838805 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34abcb1a-6802-4259-9a09-3357a7356309 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:09:59.989624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-34abcb1a-6802-4259-9a09-3357a7356309 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:09:59.997973 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-34abcb1a-6802-4259-9a09-3357a7356309 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1515 microversion: 2.1 time: 0.187228 Oct 27 14:09:59.998669 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 175/358] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:09:59 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:00.282916 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a9a3a2a0-1c8d-46e7-8d68-6d1c9c0c1e88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:00.283877 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a9a3a2a0-1c8d-46e7-8d68-6d1c9c0c1e88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:00.309164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a1aa7ce6-ec12-44b3-82da-65c714ab37ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:00.310920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a1aa7ce6-ec12-44b3-82da-65c714ab37ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:00.313596 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a9a3a2a0-1c8d-46e7-8d68-6d1c9c0c1e88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:00.314994 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a9a3a2a0-1c8d-46e7-8d68-6d1c9c0c1e88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:00.317392 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a9a3a2a0-1c8d-46e7-8d68-6d1c9c0c1e88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:00.319269 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a9a3a2a0-1c8d-46e7-8d68-6d1c9c0c1e88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:00.321494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a1aa7ce6-ec12-44b3-82da-65c714ab37ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:00.323698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a1aa7ce6-ec12-44b3-82da-65c714ab37ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:00.330102 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a1aa7ce6-ec12-44b3-82da-65c714ab37ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:00.330560 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a1aa7ce6-ec12-44b3-82da-65c714ab37ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:00.504523 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a9a3a2a0-1c8d-46e7-8d68-6d1c9c0c1e88 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28172 microversion: 2.20 time: 0.226001 Oct 27 14:10:00.505603 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 184/359] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:00 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28172 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:00.524927 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a1aa7ce6-ec12-44b3-82da-65c714ab37ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.219567 Oct 27 14:10:00.525572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 176/360] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:00 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:00.829945 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-bc1521d9-5d65-40e7-8b0c-2b2741e87c95 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:00.830910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-bc1521d9-5d65-40e7-8b0c-2b2741e87c95 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:00.838366 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc1521d9-5d65-40e7-8b0c-2b2741e87c95 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:00.838930 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc1521d9-5d65-40e7-8b0c-2b2741e87c95 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:00.839867 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc1521d9-5d65-40e7-8b0c-2b2741e87c95 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:00.840665 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc1521d9-5d65-40e7-8b0c-2b2741e87c95 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:00.977772 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-bc1521d9-5d65-40e7-8b0c-2b2741e87c95 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:00.987389 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-bc1521d9-5d65-40e7-8b0c-2b2741e87c95 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.162709 Oct 27 14:10:00.988429 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 185/361] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:00 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:01.435769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0e0d5773-9119-4def-9d02-a45e7f477424 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:01.436778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0e0d5773-9119-4def-9d02-a45e7f477424 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:01.443848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e0d5773-9119-4def-9d02-a45e7f477424 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:01.444290 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e0d5773-9119-4def-9d02-a45e7f477424 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:01.445047 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e0d5773-9119-4def-9d02-a45e7f477424 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:01.445507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e0d5773-9119-4def-9d02-a45e7f477424 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:01.469851 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-0e0d5773-9119-4def-9d02-a45e7f477424 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lazy-loading 'flavor' on Instance uuid adbc567f-bc87-48cd-b910-ba46c84f914d {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:10:01.516590 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a243be73-6e95-4b21-a0e5-a62c0bac604c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:01.517665 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a243be73-6e95-4b21-a0e5-a62c0bac604c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:01.524078 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a243be73-6e95-4b21-a0e5-a62c0bac604c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:01.524610 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a243be73-6e95-4b21-a0e5-a62c0bac604c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:01.525453 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a243be73-6e95-4b21-a0e5-a62c0bac604c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:01.525903 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a243be73-6e95-4b21-a0e5-a62c0bac604c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:01.545046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0e0d5773-9119-4def-9d02-a45e7f477424 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/action" status: 200 len: 32 microversion: 2.1 time: 0.113512 Oct 27 14:10:01.545653 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 177/362] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:01 2021] POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/action => generated 32 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:10:01.550634 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-753598dd-df89-42e4-af04-9d2d6a0d0ad8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:01.551684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-753598dd-df89-42e4-af04-9d2d6a0d0ad8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:01.557939 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-753598dd-df89-42e4-af04-9d2d6a0d0ad8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:01.558490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-753598dd-df89-42e4-af04-9d2d6a0d0ad8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:01.559667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-753598dd-df89-42e4-af04-9d2d6a0d0ad8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:01.559800 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-753598dd-df89-42e4-af04-9d2d6a0d0ad8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:01.664198 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a243be73-6e95-4b21-a0e5-a62c0bac604c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28172 microversion: 2.20 time: 0.151310 Oct 27 14:10:01.665383 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 186/363] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:01 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28172 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:10:01.670790 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0c310c23-e2ab-4167-b24c-28a8962fd125 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:01.671517 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0c310c23-e2ab-4167-b24c-28a8962fd125 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:01.678382 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0c310c23-e2ab-4167-b24c-28a8962fd125 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:01.678834 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0c310c23-e2ab-4167-b24c-28a8962fd125 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:01.679643 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0c310c23-e2ab-4167-b24c-28a8962fd125 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:01.680079 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0c310c23-e2ab-4167-b24c-28a8962fd125 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:01.686235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-753598dd-df89-42e4-af04-9d2d6a0d0ad8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.139205 Oct 27 14:10:01.690251 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 178/364] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:01 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:01.894088 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-0c310c23-e2ab-4167-b24c-28a8962fd125 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:01.902346 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0c310c23-e2ab-4167-b24c-28a8962fd125 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.235640 Oct 27 14:10:01.902856 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 187/365] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:01 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:02.006346 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-297d723c-ba8c-4cb5-b970-1b7a0798d394 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:02.007193 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-297d723c-ba8c-4cb5-b970-1b7a0798d394 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:02.014192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-297d723c-ba8c-4cb5-b970-1b7a0798d394 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:02.014725 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-297d723c-ba8c-4cb5-b970-1b7a0798d394 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:02.015607 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-297d723c-ba8c-4cb5-b970-1b7a0798d394 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:02.016147 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-297d723c-ba8c-4cb5-b970-1b7a0798d394 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:02.222179 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-297d723c-ba8c-4cb5-b970-1b7a0798d394 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:02.239480 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-297d723c-ba8c-4cb5-b970-1b7a0798d394 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1316 microversion: 2.1 time: 0.237386 Oct 27 14:10:02.240437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 179/366] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:02 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:02.266700 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1000600455", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "networks": [{"uuid": "9a3a3d90-aa72-4eeb-9ef8-20afdb56ecfd"}]}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:02.340892 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.network.neutron [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] validate_networks() for [('9a3a3d90-aa72-4eeb-9ef8-20afdb56ecfd', None, None, None, None, None)] {{(pid=115932) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:10:02.680960 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2234cd33-31b7-41f5-b3a2-e77c96ef5cd0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:02.682557 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2234cd33-31b7-41f5-b3a2-e77c96ef5cd0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:02.709328 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2234cd33-31b7-41f5-b3a2-e77c96ef5cd0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:02.710697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2234cd33-31b7-41f5-b3a2-e77c96ef5cd0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:02.711909 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2234cd33-31b7-41f5-b3a2-e77c96ef5cd0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:02.712491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2234cd33-31b7-41f5-b3a2-e77c96ef5cd0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:02.764165 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Flavor limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:10:02.764711 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Image limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:10:02.765271 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Flavor pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:10:02.765771 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Image pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:10:02.766247 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:10:02.776190 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:02.776709 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:02.777585 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:02.778088 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:02.795526 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Getting quotas for project 403cbdd2f7e54a148b5f8f44b38a045d. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:10:02.799757 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Getting quotas for user 0014f5c117f04c9295a0fcdd35a6b56b and project 403cbdd2f7e54a148b5f8f44b38a045d. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:10:02.812156 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Going to run 1 instances... {{(pid=115932) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:10:02.814653 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:10:02.834511 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2234cd33-31b7-41f5-b3a2-e77c96ef5cd0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28172 microversion: 2.20 time: 0.161599 Oct 27 14:10:02.835297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 180/367] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:02 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28172 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:10:02.840707 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-eb5d425e-0ca8-4b77-912d-18c411cdbd3a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:02.841956 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-eb5d425e-0ca8-4b77-912d-18c411cdbd3a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:02.849582 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb5d425e-0ca8-4b77-912d-18c411cdbd3a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:02.850165 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb5d425e-0ca8-4b77-912d-18c411cdbd3a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:02.851092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb5d425e-0ca8-4b77-912d-18c411cdbd3a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:02.851612 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb5d425e-0ca8-4b77-912d-18c411cdbd3a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:02.877568 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4eeefe5d-35b8-448d-8a48-9c801de768a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614556 Oct 27 14:10:02.878915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 188/368] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:10:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:10:02.889195 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-81cd2573-20b0-4fa6-ad53-99a8bafd3635 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:02.889997 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-81cd2573-20b0-4fa6-ad53-99a8bafd3635 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:02.946176 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-81cd2573-20b0-4fa6-ad53-99a8bafd3635 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:02.955385 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-81cd2573-20b0-4fa6-ad53-99a8bafd3635 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1214 microversion: 2.1 time: 0.070076 Oct 27 14:10:02.963425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 189/369] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:02 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:02.963425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-02992eb6-1c39-4f43-9010-9424e6c15cc7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:02.963425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-02992eb6-1c39-4f43-9010-9424e6c15cc7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:02.972238 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-02992eb6-1c39-4f43-9010-9424e6c15cc7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:02.972628 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-02992eb6-1c39-4f43-9010-9424e6c15cc7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:02.973483 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-02992eb6-1c39-4f43-9010-9424e6c15cc7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:02.973922 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-02992eb6-1c39-4f43-9010-9424e6c15cc7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:03.124309 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-02992eb6-1c39-4f43-9010-9424e6c15cc7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:03.135896 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-02992eb6-1c39-4f43-9010-9424e6c15cc7 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.178446 Oct 27 14:10:03.143233 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 190/370] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:02 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:03.154993 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-eb5d425e-0ca8-4b77-912d-18c411cdbd3a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.318129 Oct 27 14:10:03.156074 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 181/371] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:02 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:03.260878 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-62e7f704-42e1-4c90-a3cd-805199d9ad49 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:03.262180 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-62e7f704-42e1-4c90-a3cd-805199d9ad49 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:03.271155 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-62e7f704-42e1-4c90-a3cd-805199d9ad49 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:03.272199 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-62e7f704-42e1-4c90-a3cd-805199d9ad49 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:03.273191 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-62e7f704-42e1-4c90-a3cd-805199d9ad49 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:03.273949 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-62e7f704-42e1-4c90-a3cd-805199d9ad49 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:03.409491 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-62e7f704-42e1-4c90-a3cd-805199d9ad49 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:03.416971 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-62e7f704-42e1-4c90-a3cd-805199d9ad49 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1507 microversion: 2.1 time: 0.160776 Oct 27 14:10:03.417549 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 191/372] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:03 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:03.847860 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-db4fcdfa-7e26-489c-8274-6d65b8d05885 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:03.848857 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-db4fcdfa-7e26-489c-8274-6d65b8d05885 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:03.855706 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-db4fcdfa-7e26-489c-8274-6d65b8d05885 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:03.856147 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-db4fcdfa-7e26-489c-8274-6d65b8d05885 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:03.856978 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-db4fcdfa-7e26-489c-8274-6d65b8d05885 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:03.857381 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-db4fcdfa-7e26-489c-8274-6d65b8d05885 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:03.945380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-db4fcdfa-7e26-489c-8274-6d65b8d05885 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28172 microversion: 2.20 time: 0.101539 Oct 27 14:10:03.946808 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 182/373] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:03 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28172 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:03.972735 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1e5a4107-cd19-4911-bb76-0da739121637 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:03.973276 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1e5a4107-cd19-4911-bb76-0da739121637 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:03.979545 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e5a4107-cd19-4911-bb76-0da739121637 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:03.979993 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e5a4107-cd19-4911-bb76-0da739121637 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:03.980771 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e5a4107-cd19-4911-bb76-0da739121637 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:03.981239 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e5a4107-cd19-4911-bb76-0da739121637 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:04.057522 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1e5a4107-cd19-4911-bb76-0da739121637 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:04.068650 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1e5a4107-cd19-4911-bb76-0da739121637 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1266 microversion: 2.1 time: 0.099562 Oct 27 14:10:04.069518 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 192/374] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:03 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:04.155999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-511363d9-9412-48e0-8d53-24b05c28dce1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:04.156768 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-511363d9-9412-48e0-8d53-24b05c28dce1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:04.166428 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-511363d9-9412-48e0-8d53-24b05c28dce1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:04.167154 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-511363d9-9412-48e0-8d53-24b05c28dce1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:04.168145 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-511363d9-9412-48e0-8d53-24b05c28dce1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:04.168347 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1bd25e93-c629-4a5a-a559-1a800bb63db9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:04.168913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-511363d9-9412-48e0-8d53-24b05c28dce1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:04.172435 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1bd25e93-c629-4a5a-a559-1a800bb63db9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:04.181818 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1bd25e93-c629-4a5a-a559-1a800bb63db9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:04.182483 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1bd25e93-c629-4a5a-a559-1a800bb63db9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:04.183482 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1bd25e93-c629-4a5a-a559-1a800bb63db9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:04.184118 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1bd25e93-c629-4a5a-a559-1a800bb63db9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:04.287524 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1bd25e93-c629-4a5a-a559-1a800bb63db9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.123241 Oct 27 14:10:04.291571 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 193/375] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:04 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:04.665895 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-511363d9-9412-48e0-8d53-24b05c28dce1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:04.675585 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-511363d9-9412-48e0-8d53-24b05c28dce1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.524433 Oct 27 14:10:04.676178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 183/376] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:04 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:04.740225 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b3f93872-e9f2-4fec-b8b6-ec3b8b449563 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e536b50c-b012-4871-b130-4b87962fe05f"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:04.741364 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-b3f93872-e9f2-4fec-b8b6-ec3b8b449563 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:04.749545 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b3f93872-e9f2-4fec-b8b6-ec3b8b449563 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:04.750014 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b3f93872-e9f2-4fec-b8b6-ec3b8b449563 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:04.750784 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b3f93872-e9f2-4fec-b8b6-ec3b8b449563 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:04.751276 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b3f93872-e9f2-4fec-b8b6-ec3b8b449563 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:04.957920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-893508f9-5c84-4b43-afad-45114eebab64 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:04.959570 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-893508f9-5c84-4b43-afad-45114eebab64 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:04.968109 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-893508f9-5c84-4b43-afad-45114eebab64 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:04.968618 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-893508f9-5c84-4b43-afad-45114eebab64 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:04.969668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-893508f9-5c84-4b43-afad-45114eebab64 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:04.970259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-893508f9-5c84-4b43-afad-45114eebab64 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:05.037220 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b3f93872-e9f2-4fec-b8b6-ec3b8b449563 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "POST /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301045 Oct 27 14:10:05.038086 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 194/377] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:10:04 2021] POST /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:05.092224 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-89ae020f-6af6-4ac6-9112-f22ea473c669 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:05.092224 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-89ae020f-6af6-4ac6-9112-f22ea473c669 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:05.100456 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-89ae020f-6af6-4ac6-9112-f22ea473c669 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:05.101010 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-89ae020f-6af6-4ac6-9112-f22ea473c669 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:05.101892 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-89ae020f-6af6-4ac6-9112-f22ea473c669 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:05.102388 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-89ae020f-6af6-4ac6-9112-f22ea473c669 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:05.105881 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-893508f9-5c84-4b43-afad-45114eebab64 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28460 microversion: 2.20 time: 0.148882 Oct 27 14:10:05.106604 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 184/378] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:04 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28460 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:10:05.303112 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0367d467-8eaf-4c81-aa21-b76a3f6724e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:05.304559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0367d467-8eaf-4c81-aa21-b76a3f6724e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:05.313581 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-89ae020f-6af6-4ac6-9112-f22ea473c669 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:05.318689 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0367d467-8eaf-4c81-aa21-b76a3f6724e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:05.319201 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0367d467-8eaf-4c81-aa21-b76a3f6724e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:05.321549 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-89ae020f-6af6-4ac6-9112-f22ea473c669 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1314 microversion: 2.1 time: 0.238845 Oct 27 14:10:05.322722 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 195/379] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:05 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:05.324269 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0367d467-8eaf-4c81-aa21-b76a3f6724e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:05.324724 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0367d467-8eaf-4c81-aa21-b76a3f6724e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:05.454776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0367d467-8eaf-4c81-aa21-b76a3f6724e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.157155 Oct 27 14:10:05.458699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 185/380] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:05 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:05.699255 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4e93fcc2-8304-4800-a0a5-0dcb2dc1289c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:05.700436 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4e93fcc2-8304-4800-a0a5-0dcb2dc1289c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:05.708053 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e93fcc2-8304-4800-a0a5-0dcb2dc1289c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:05.708495 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e93fcc2-8304-4800-a0a5-0dcb2dc1289c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:05.709317 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e93fcc2-8304-4800-a0a5-0dcb2dc1289c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:05.709756 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e93fcc2-8304-4800-a0a5-0dcb2dc1289c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:05.893525 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4e93fcc2-8304-4800-a0a5-0dcb2dc1289c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:05.901618 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4e93fcc2-8304-4800-a0a5-0dcb2dc1289c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.208624 Oct 27 14:10:05.902378 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 196/381] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:05 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:05.938980 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-7ae5ab1c-d25e-4743-867a-98d12ae96a5e req-9efcbdb4-7ce5-48db-b021-5e44ed590152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c186e5da-fd06-448a-9e65-3701f44796c4", "tag": "3be7433d-feae-4897-986b-6ca3cbba65f8"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:05.940612 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:10:05.940612 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:10:05.949292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-7ae5ab1c-d25e-4743-867a-98d12ae96a5e req-9efcbdb4-7ce5-48db-b021-5e44ed590152 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:05.949820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-7ae5ab1c-d25e-4743-867a-98d12ae96a5e req-9efcbdb4-7ce5-48db-b021-5e44ed590152 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:05.964987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-7ae5ab1c-d25e-4743-867a-98d12ae96a5e req-9efcbdb4-7ce5-48db-b021-5e44ed590152 service nova] Creating event network-changed:3be7433d-feae-4897-986b-6ca3cbba65f8 for instance c186e5da-fd06-448a-9e65-3701f44796c4 on hv-cinder-81566 Oct 27 14:10:05.970184 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-7ae5ab1c-d25e-4743-867a-98d12ae96a5e req-9efcbdb4-7ce5-48db-b021-5e44ed590152 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034911 Oct 27 14:10:05.970320 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 186/382] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:10:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:06.117702 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1db10808-1d68-4d33-9b05-ee749f008ece tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:06.118693 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1db10808-1d68-4d33-9b05-ee749f008ece tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:06.125670 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1db10808-1d68-4d33-9b05-ee749f008ece tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:06.126127 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1db10808-1d68-4d33-9b05-ee749f008ece tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:06.126902 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1db10808-1d68-4d33-9b05-ee749f008ece tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:06.127373 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1db10808-1d68-4d33-9b05-ee749f008ece tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:06.340192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1dc37cc4-f4f0-4e5f-9466-82af74d88c1a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:06.340881 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1dc37cc4-f4f0-4e5f-9466-82af74d88c1a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:06.347546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1dc37cc4-f4f0-4e5f-9466-82af74d88c1a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:06.347991 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1dc37cc4-f4f0-4e5f-9466-82af74d88c1a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:06.348758 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1dc37cc4-f4f0-4e5f-9466-82af74d88c1a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:06.349191 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1dc37cc4-f4f0-4e5f-9466-82af74d88c1a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:06.482568 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1dc37cc4-f4f0-4e5f-9466-82af74d88c1a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:06.490309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1dc37cc4-f4f0-4e5f-9466-82af74d88c1a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1314 microversion: 2.1 time: 0.154693 Oct 27 14:10:06.490878 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 187/383] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:06 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:06.495202 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2073f922-0279-4329-a4a2-d12bb432b93a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:06.496165 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2073f922-0279-4329-a4a2-d12bb432b93a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:06.501630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2073f922-0279-4329-a4a2-d12bb432b93a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:06.502077 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2073f922-0279-4329-a4a2-d12bb432b93a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:06.502840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2073f922-0279-4329-a4a2-d12bb432b93a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:06.503566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2073f922-0279-4329-a4a2-d12bb432b93a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:09.266631 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1db10808-1d68-4d33-9b05-ee749f008ece tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28460 microversion: 2.20 time: 3.152379 Oct 27 14:10:09.267734 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 197/384] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:06 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28460 bytes in 3154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:09.275502 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-6a73601d-b871-40eb-badf-e34771de8d7a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:09.276335 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-6a73601d-b871-40eb-badf-e34771de8d7a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:09.283628 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6a73601d-b871-40eb-badf-e34771de8d7a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:09.284085 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6a73601d-b871-40eb-badf-e34771de8d7a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:09.284886 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6a73601d-b871-40eb-badf-e34771de8d7a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:09.285320 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6a73601d-b871-40eb-badf-e34771de8d7a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:09.298493 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2073f922-0279-4329-a4a2-d12bb432b93a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 2.797791 Oct 27 14:10:09.302466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 188/385] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:06 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 2808 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:09.304297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6505c2a3-f19b-48af-89e7-bbb4f25c94f2 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:09.305037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6505c2a3-f19b-48af-89e7-bbb4f25c94f2 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:09.312466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6505c2a3-f19b-48af-89e7-bbb4f25c94f2 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:09.312985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6505c2a3-f19b-48af-89e7-bbb4f25c94f2 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:09.313852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6505c2a3-f19b-48af-89e7-bbb4f25c94f2 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:09.314393 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6505c2a3-f19b-48af-89e7-bbb4f25c94f2 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:09.577212 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-6a73601d-b871-40eb-badf-e34771de8d7a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:09.585155 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-6a73601d-b871-40eb-badf-e34771de8d7a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.316678 Oct 27 14:10:09.585706 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 198/386] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:09 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:09.596717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6505c2a3-f19b-48af-89e7-bbb4f25c94f2 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:09.604826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6505c2a3-f19b-48af-89e7-bbb4f25c94f2 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1314 microversion: 2.1 time: 0.304356 Oct 27 14:10:09.605392 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 189/387] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:09 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:10.277902 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-101f102f-34ac-483e-81fc-b8c6710b0881 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:10.279593 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-101f102f-34ac-483e-81fc-b8c6710b0881 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:10.286528 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-101f102f-34ac-483e-81fc-b8c6710b0881 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:10.286964 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-101f102f-34ac-483e-81fc-b8c6710b0881 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:10.287765 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-101f102f-34ac-483e-81fc-b8c6710b0881 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:10.288207 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-101f102f-34ac-483e-81fc-b8c6710b0881 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:10.309668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4c23d03f-cf02-45fd-83fb-f405aeb55fe8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:10.312097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4c23d03f-cf02-45fd-83fb-f405aeb55fe8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:10.319555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c23d03f-cf02-45fd-83fb-f405aeb55fe8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:10.320000 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c23d03f-cf02-45fd-83fb-f405aeb55fe8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:10.320770 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c23d03f-cf02-45fd-83fb-f405aeb55fe8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:10.321198 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c23d03f-cf02-45fd-83fb-f405aeb55fe8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:10.418547 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-101f102f-34ac-483e-81fc-b8c6710b0881 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28622 microversion: 2.20 time: 0.144254 Oct 27 14:10:10.422454 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 199/388] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:10 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28622 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:10.446150 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4c23d03f-cf02-45fd-83fb-f405aeb55fe8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.139928 Oct 27 14:10:10.446799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 190/389] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:10 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:10.603275 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1339f05f-c9c7-46e7-922b-f864cc0dc0d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:10.603950 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1339f05f-c9c7-46e7-922b-f864cc0dc0d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:10.611145 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1339f05f-c9c7-46e7-922b-f864cc0dc0d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:10.611592 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1339f05f-c9c7-46e7-922b-f864cc0dc0d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:10.612362 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1339f05f-c9c7-46e7-922b-f864cc0dc0d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:10.612786 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1339f05f-c9c7-46e7-922b-f864cc0dc0d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:10.623027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3f252823-433c-4b6e-8dc9-435050e07fb5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:10.624891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3f252823-433c-4b6e-8dc9-435050e07fb5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:10.651166 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f252823-433c-4b6e-8dc9-435050e07fb5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:10.651685 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f252823-433c-4b6e-8dc9-435050e07fb5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:10.652551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f252823-433c-4b6e-8dc9-435050e07fb5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:10.653055 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f252823-433c-4b6e-8dc9-435050e07fb5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:10.802337 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1339f05f-c9c7-46e7-922b-f864cc0dc0d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:10.811940 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1339f05f-c9c7-46e7-922b-f864cc0dc0d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.212317 Oct 27 14:10:10.812502 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 200/390] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:10 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:10.819813 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3f252823-433c-4b6e-8dc9-435050e07fb5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:10.828169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3f252823-433c-4b6e-8dc9-435050e07fb5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1314 microversion: 2.1 time: 0.209195 Oct 27 14:10:10.828736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 191/391] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:10 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:11.430060 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a441f0d1-c68d-4d59-ba9c-998bf337bee7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:11.430981 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a441f0d1-c68d-4d59-ba9c-998bf337bee7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:11.438094 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a441f0d1-c68d-4d59-ba9c-998bf337bee7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:11.438540 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a441f0d1-c68d-4d59-ba9c-998bf337bee7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:11.439363 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a441f0d1-c68d-4d59-ba9c-998bf337bee7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:11.439795 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a441f0d1-c68d-4d59-ba9c-998bf337bee7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:11.458147 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-14e88935-812e-43d9-903d-d72e1367aa6c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:11.459290 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-14e88935-812e-43d9-903d-d72e1367aa6c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:11.466172 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-14e88935-812e-43d9-903d-d72e1367aa6c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:11.466496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-14e88935-812e-43d9-903d-d72e1367aa6c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:11.467303 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-14e88935-812e-43d9-903d-d72e1367aa6c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:11.467742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-14e88935-812e-43d9-903d-d72e1367aa6c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:11.539680 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a441f0d1-c68d-4d59-ba9c-998bf337bee7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28622 microversion: 2.20 time: 0.113257 Oct 27 14:10:11.540352 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 201/392] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:11 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28622 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:11.574177 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-14e88935-812e-43d9-903d-d72e1367aa6c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.119487 Oct 27 14:10:11.574819 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 192/393] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:11 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:11.829311 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a33f2ff9-0448-4317-ae65-4b41e1123338 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:11.830035 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a33f2ff9-0448-4317-ae65-4b41e1123338 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:11.837580 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a33f2ff9-0448-4317-ae65-4b41e1123338 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:11.838009 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a33f2ff9-0448-4317-ae65-4b41e1123338 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:11.838766 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a33f2ff9-0448-4317-ae65-4b41e1123338 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:11.839511 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a33f2ff9-0448-4317-ae65-4b41e1123338 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:11.846024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-11303e92-279e-431b-beb5-775dd31b7e95 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:11.847154 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-11303e92-279e-431b-beb5-775dd31b7e95 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:11.855246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11303e92-279e-431b-beb5-775dd31b7e95 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:11.855874 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11303e92-279e-431b-beb5-775dd31b7e95 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:11.856697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11303e92-279e-431b-beb5-775dd31b7e95 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:11.857917 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11303e92-279e-431b-beb5-775dd31b7e95 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:12.023988 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a33f2ff9-0448-4317-ae65-4b41e1123338 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:12.035059 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a33f2ff9-0448-4317-ae65-4b41e1123338 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.209894 Oct 27 14:10:12.036004 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 202/394] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:11 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:12.046301 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-11303e92-279e-431b-beb5-775dd31b7e95 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:12.054793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-11303e92-279e-431b-beb5-775dd31b7e95 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1314 microversion: 2.1 time: 0.214340 Oct 27 14:10:12.055427 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 193/395] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:11 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:12.552527 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-401b25d8-2fe4-4449-81ce-36612901b6c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:12.553608 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-401b25d8-2fe4-4449-81ce-36612901b6c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:12.560781 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-401b25d8-2fe4-4449-81ce-36612901b6c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:12.561347 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-401b25d8-2fe4-4449-81ce-36612901b6c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:12.562444 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-401b25d8-2fe4-4449-81ce-36612901b6c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:12.563074 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-401b25d8-2fe4-4449-81ce-36612901b6c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:12.586167 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1570d2ff-0676-42bd-9fbe-3f70441537ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:12.587167 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1570d2ff-0676-42bd-9fbe-3f70441537ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:12.597060 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1570d2ff-0676-42bd-9fbe-3f70441537ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:12.597502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1570d2ff-0676-42bd-9fbe-3f70441537ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:12.600257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1570d2ff-0676-42bd-9fbe-3f70441537ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:12.600872 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1570d2ff-0676-42bd-9fbe-3f70441537ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:12.706974 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-401b25d8-2fe4-4449-81ce-36612901b6c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28622 microversion: 2.20 time: 0.158579 Oct 27 14:10:12.708266 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 203/396] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:12 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28622 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:12.711772 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1570d2ff-0676-42bd-9fbe-3f70441537ae tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.129522 Oct 27 14:10:12.715575 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 194/397] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:12 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:13.056910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8884064b-6317-4303-b1dd-74fc5253125c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:13.056910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-8884064b-6317-4303-b1dd-74fc5253125c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:13.063467 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8884064b-6317-4303-b1dd-74fc5253125c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:13.063932 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8884064b-6317-4303-b1dd-74fc5253125c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:13.064718 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8884064b-6317-4303-b1dd-74fc5253125c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:13.065156 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8884064b-6317-4303-b1dd-74fc5253125c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:13.074776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-02ea21a5-64f5-4f44-95ae-e5a8313ac0c3 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:13.077301 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-02ea21a5-64f5-4f44-95ae-e5a8313ac0c3 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:13.085177 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-02ea21a5-64f5-4f44-95ae-e5a8313ac0c3 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:13.085933 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-02ea21a5-64f5-4f44-95ae-e5a8313ac0c3 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:13.086834 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-02ea21a5-64f5-4f44-95ae-e5a8313ac0c3 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:13.087573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-02ea21a5-64f5-4f44-95ae-e5a8313ac0c3 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:13.264708 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-02ea21a5-64f5-4f44-95ae-e5a8313ac0c3 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:13.272425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-02ea21a5-64f5-4f44-95ae-e5a8313ac0c3 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1314 microversion: 2.1 time: 0.202080 Oct 27 14:10:13.273003 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 195/398] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:13 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:13.273492 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-8884064b-6317-4303-b1dd-74fc5253125c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:13.281992 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-8884064b-6317-4303-b1dd-74fc5253125c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.231104 Oct 27 14:10:13.282613 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 204/399] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:13 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:13.719473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-44ebc692-5fdd-4482-9a65-3233da7c4e71 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:13.720394 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-44ebc692-5fdd-4482-9a65-3233da7c4e71 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:13.723485 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c48dd389-8b87-4e91-b58c-f4bc9cbfe6e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:13.724563 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c48dd389-8b87-4e91-b58c-f4bc9cbfe6e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:13.727994 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44ebc692-5fdd-4482-9a65-3233da7c4e71 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:13.728806 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44ebc692-5fdd-4482-9a65-3233da7c4e71 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:13.729950 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44ebc692-5fdd-4482-9a65-3233da7c4e71 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:13.730314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44ebc692-5fdd-4482-9a65-3233da7c4e71 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:13.730603 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c48dd389-8b87-4e91-b58c-f4bc9cbfe6e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:13.731102 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c48dd389-8b87-4e91-b58c-f4bc9cbfe6e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:13.731952 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c48dd389-8b87-4e91-b58c-f4bc9cbfe6e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:13.733155 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c48dd389-8b87-4e91-b58c-f4bc9cbfe6e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:13.844537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-44ebc692-5fdd-4482-9a65-3233da7c4e71 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28622 microversion: 2.20 time: 0.129164 Oct 27 14:10:13.845195 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 196/400] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:13 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28622 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:13.855097 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c48dd389-8b87-4e91-b58c-f4bc9cbfe6e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.135492 Oct 27 14:10:13.859837 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 205/401] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:13 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:14.289695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-15812354-2611-4e62-9707-ad643234c40f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:14.290714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-15812354-2611-4e62-9707-ad643234c40f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:14.299307 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7210e027-0248-446c-8f55-75adcd639e7f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:14.299769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-15812354-2611-4e62-9707-ad643234c40f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:14.300221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-15812354-2611-4e62-9707-ad643234c40f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:14.300770 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7210e027-0248-446c-8f55-75adcd639e7f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:14.301176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-15812354-2611-4e62-9707-ad643234c40f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:14.301620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-15812354-2611-4e62-9707-ad643234c40f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:14.309420 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7210e027-0248-446c-8f55-75adcd639e7f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:14.310436 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7210e027-0248-446c-8f55-75adcd639e7f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:14.311565 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7210e027-0248-446c-8f55-75adcd639e7f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:14.312178 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7210e027-0248-446c-8f55-75adcd639e7f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:14.598136 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-15812354-2611-4e62-9707-ad643234c40f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:14.605420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-15812354-2611-4e62-9707-ad643234c40f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1314 microversion: 2.1 time: 0.319959 Oct 27 14:10:14.616261 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 197/402] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:14 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:14.616769 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-7210e027-0248-446c-8f55-75adcd639e7f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:14.626168 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7210e027-0248-446c-8f55-75adcd639e7f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.330801 Oct 27 14:10:14.636925 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 206/403] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:14 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:14.856631 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6b5f52e7-b75e-4406-a151-74c2d43415db tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:14.858262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6b5f52e7-b75e-4406-a151-74c2d43415db tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:14.865801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6b5f52e7-b75e-4406-a151-74c2d43415db tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:14.866524 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6b5f52e7-b75e-4406-a151-74c2d43415db tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:14.867472 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6b5f52e7-b75e-4406-a151-74c2d43415db tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:14.868070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6b5f52e7-b75e-4406-a151-74c2d43415db tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:14.869928 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2630dda9-5178-4d61-9146-0e1fd34427e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:14.871627 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2630dda9-5178-4d61-9146-0e1fd34427e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:14.881134 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2630dda9-5178-4d61-9146-0e1fd34427e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:14.881939 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2630dda9-5178-4d61-9146-0e1fd34427e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:14.883236 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2630dda9-5178-4d61-9146-0e1fd34427e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:14.884008 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2630dda9-5178-4d61-9146-0e1fd34427e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:14.963490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6b5f52e7-b75e-4406-a151-74c2d43415db tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28622 microversion: 2.20 time: 0.110417 Oct 27 14:10:14.964976 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 198/404] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:14 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28622 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:14.985803 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2630dda9-5178-4d61-9146-0e1fd34427e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28634 microversion: 2.1 time: 0.121861 Oct 27 14:10:14.987044 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 207/405] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:14 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28634 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:15.624929 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-745a93ee-09bb-42f4-a65f-0beca8acd0ad tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:15.625619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-745a93ee-09bb-42f4-a65f-0beca8acd0ad tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:15.634278 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-745a93ee-09bb-42f4-a65f-0beca8acd0ad tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:15.634725 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-745a93ee-09bb-42f4-a65f-0beca8acd0ad tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:15.635534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-745a93ee-09bb-42f4-a65f-0beca8acd0ad tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:15.635956 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-745a93ee-09bb-42f4-a65f-0beca8acd0ad tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:15.644161 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-642c75b4-884f-4355-a0c2-e5445a08fb75 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:15.645102 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-642c75b4-884f-4355-a0c2-e5445a08fb75 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:15.655028 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-642c75b4-884f-4355-a0c2-e5445a08fb75 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:15.656164 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-642c75b4-884f-4355-a0c2-e5445a08fb75 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:15.657949 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-642c75b4-884f-4355-a0c2-e5445a08fb75 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:15.658715 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-642c75b4-884f-4355-a0c2-e5445a08fb75 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:15.860125 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-642c75b4-884f-4355-a0c2-e5445a08fb75 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:15.868006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-745a93ee-09bb-42f4-a65f-0beca8acd0ad tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:15.868593 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-642c75b4-884f-4355-a0c2-e5445a08fb75 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.229084 Oct 27 14:10:15.868897 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 208/406] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:15 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:15.881707 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-745a93ee-09bb-42f4-a65f-0beca8acd0ad tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1314 microversion: 2.1 time: 0.262124 Oct 27 14:10:15.882139 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 199/407] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:15 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:15.976721 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-be533667-5590-4263-a942-1649019f5903 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:15.977633 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-be533667-5590-4263-a942-1649019f5903 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:15.985483 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-be533667-5590-4263-a942-1649019f5903 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:15.986030 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-be533667-5590-4263-a942-1649019f5903 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:15.986814 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-be533667-5590-4263-a942-1649019f5903 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:15.987276 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-be533667-5590-4263-a942-1649019f5903 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:15.998107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3b5e1a0a-6864-4d3b-8c2d-c1e99a4475d4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:15.999396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3b5e1a0a-6864-4d3b-8c2d-c1e99a4475d4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:16.007103 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3b5e1a0a-6864-4d3b-8c2d-c1e99a4475d4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:16.007773 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3b5e1a0a-6864-4d3b-8c2d-c1e99a4475d4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:16.008553 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3b5e1a0a-6864-4d3b-8c2d-c1e99a4475d4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:16.009203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3b5e1a0a-6864-4d3b-8c2d-c1e99a4475d4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:16.094352 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-be533667-5590-4263-a942-1649019f5903 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28622 microversion: 2.20 time: 0.121019 Oct 27 14:10:16.095336 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 209/408] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:15 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28622 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:16.153589 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3b5e1a0a-6864-4d3b-8c2d-c1e99a4475d4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 28787 microversion: 2.1 time: 0.159232 Oct 27 14:10:16.158963 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 200/409] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:15 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 28787 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:16.179343 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-acffff9e-f243-4494-8683-aa895befcf5d req-4a1f04e4-eb0c-493f-82a0-4eff534b52b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c186e5da-fd06-448a-9e65-3701f44796c4", "name": "network-vif-plugged", "status": "completed", "tag": "3be7433d-feae-4897-986b-6ca3cbba65f8"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:16.180824 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:10:16.180824 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:10:16.188786 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-acffff9e-f243-4494-8683-aa895befcf5d req-4a1f04e4-eb0c-493f-82a0-4eff534b52b5 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:16.189675 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-acffff9e-f243-4494-8683-aa895befcf5d req-4a1f04e4-eb0c-493f-82a0-4eff534b52b5 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:16.208971 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-acffff9e-f243-4494-8683-aa895befcf5d req-4a1f04e4-eb0c-493f-82a0-4eff534b52b5 service nova] Creating event network-vif-plugged:3be7433d-feae-4897-986b-6ca3cbba65f8 for instance c186e5da-fd06-448a-9e65-3701f44796c4 on hv-cinder-81566 Oct 27 14:10:16.219411 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-acffff9e-f243-4494-8683-aa895befcf5d req-4a1f04e4-eb0c-493f-82a0-4eff534b52b5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043852 Oct 27 14:10:16.220861 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 210/410] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:10:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:16.352578 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-795215771", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:16.410060 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] validate_networks() for None {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:10:16.739006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:10:16.739459 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:10:16.739939 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:10:16.740349 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:10:16.740754 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:10:16.744159 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c15af0de-4be3-46ac-ab82-2459c8448fe6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9da55013-f2fd-4e9d-a683-8a43b726991c", "device": "/dev/sdb"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:16.745892 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c15af0de-4be3-46ac-ab82-2459c8448fe6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:16.751063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:16.751606 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:16.752353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:16.752971 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:16.754657 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c15af0de-4be3-46ac-ab82-2459c8448fe6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:16.755264 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c15af0de-4be3-46ac-ab82-2459c8448fe6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:16.756290 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c15af0de-4be3-46ac-ab82-2459c8448fe6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:16.756912 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c15af0de-4be3-46ac-ab82-2459c8448fe6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:16.771388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Getting quotas for project fa1707281ac842ec85cb153002938ed7. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:10:16.776213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Getting quotas for user 27d366d8ea924851b762ebfeaf23f433 and project fa1707281ac842ec85cb153002938ed7. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:10:16.788070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:10:16.790814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:10:16.839863 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7e19ef15-2907-430a-84ff-e74c1e002a64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491173 Oct 27 14:10:16.841042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 201/411] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:10:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:10:16.853109 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9fdf54b6-d32b-46bf-9217-5df80581bdc8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:16.853842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9fdf54b6-d32b-46bf-9217-5df80581bdc8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:16.942289 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9fdf54b6-d32b-46bf-9217-5df80581bdc8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:16.957576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9fdf54b6-d32b-46bf-9217-5df80581bdc8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1214 microversion: 2.1 time: 0.109021 Oct 27 14:10:16.958196 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 202/412] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:16 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:16.962732 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-65df2912-6041-49d8-9501-de916a6f3838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:16.963384 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-65df2912-6041-49d8-9501-de916a6f3838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:16.982015 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65df2912-6041-49d8-9501-de916a6f3838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:16.983343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65df2912-6041-49d8-9501-de916a6f3838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:16.984841 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65df2912-6041-49d8-9501-de916a6f3838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:16.985993 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65df2912-6041-49d8-9501-de916a6f3838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:17.109685 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c15af0de-4be3-46ac-ab82-2459c8448fe6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "POST /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370587 Oct 27 14:10:17.110302 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 211/413] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:10:16 2021] POST /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:17.129917 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f6887d8a-3418-4207-9fdc-9d48ace2b01b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:17.130843 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f6887d8a-3418-4207-9fdc-9d48ace2b01b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:17.143154 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f6887d8a-3418-4207-9fdc-9d48ace2b01b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:17.155933 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f6887d8a-3418-4207-9fdc-9d48ace2b01b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:17.156996 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f6887d8a-3418-4207-9fdc-9d48ace2b01b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:17.157590 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f6887d8a-3418-4207-9fdc-9d48ace2b01b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:17.345747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-65df2912-6041-49d8-9501-de916a6f3838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:17.355610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-65df2912-6041-49d8-9501-de916a6f3838 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.396164 Oct 27 14:10:17.356642 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 203/414] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:16 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:17.362409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a7fdde47-32c7-4827-9d09-c3da1eaadeb7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:17.364909 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a7fdde47-32c7-4827-9d09-c3da1eaadeb7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:17.371334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a7fdde47-32c7-4827-9d09-c3da1eaadeb7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:17.371855 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a7fdde47-32c7-4827-9d09-c3da1eaadeb7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:17.372862 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a7fdde47-32c7-4827-9d09-c3da1eaadeb7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:17.373285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a7fdde47-32c7-4827-9d09-c3da1eaadeb7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:17.458736 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-f6887d8a-3418-4207-9fdc-9d48ace2b01b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:17.461637 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a7fdde47-32c7-4827-9d09-c3da1eaadeb7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28622 microversion: 2.20 time: 0.103019 Oct 27 14:10:17.468064 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 204/415] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:17 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28622 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:17.475637 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f6887d8a-3418-4207-9fdc-9d48ace2b01b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1314 microversion: 2.1 time: 0.361108 Oct 27 14:10:17.477418 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2d0b6866-889a-4848-96f4-cfe3db4ba81c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:17.479426 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2d0b6866-889a-4848-96f4-cfe3db4ba81c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:17.487875 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 212/416] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:17 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:17.491465 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2d0b6866-889a-4848-96f4-cfe3db4ba81c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:17.492002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2d0b6866-889a-4848-96f4-cfe3db4ba81c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:17.492888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2d0b6866-889a-4848-96f4-cfe3db4ba81c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:17.493431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2d0b6866-889a-4848-96f4-cfe3db4ba81c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:17.610720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2d0b6866-889a-4848-96f4-cfe3db4ba81c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 30174 microversion: 2.1 time: 0.140684 Oct 27 14:10:17.614778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 205/417] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:17 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 30174 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:17.975795 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-83ea3c40-e1f5-445d-b55e-17f8bcb4afc7 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:17.976757 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-83ea3c40-e1f5-445d-b55e-17f8bcb4afc7 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:17.985459 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-83ea3c40-e1f5-445d-b55e-17f8bcb4afc7 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:17.986168 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-83ea3c40-e1f5-445d-b55e-17f8bcb4afc7 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:17.987029 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-83ea3c40-e1f5-445d-b55e-17f8bcb4afc7 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:17.987629 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-83ea3c40-e1f5-445d-b55e-17f8bcb4afc7 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:18.107919 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-83ea3c40-e1f5-445d-b55e-17f8bcb4afc7 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:18.116138 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-83ea3c40-e1f5-445d-b55e-17f8bcb4afc7 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1266 microversion: 2.1 time: 0.144096 Oct 27 14:10:18.117047 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 213/418] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:17 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:18.389988 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-23d7df06-1203-4e3c-92ec-374b24295595 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:18.393655 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-23d7df06-1203-4e3c-92ec-374b24295595 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:18.411807 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-23d7df06-1203-4e3c-92ec-374b24295595 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:18.416263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-23d7df06-1203-4e3c-92ec-374b24295595 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:18.418016 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-23d7df06-1203-4e3c-92ec-374b24295595 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:18.418981 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-23d7df06-1203-4e3c-92ec-374b24295595 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:18.478889 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1f31fce2-003c-47cb-8db4-fe8832639ef1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:18.480758 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1f31fce2-003c-47cb-8db4-fe8832639ef1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:18.495023 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1f31fce2-003c-47cb-8db4-fe8832639ef1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:18.495960 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1f31fce2-003c-47cb-8db4-fe8832639ef1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:18.497231 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1f31fce2-003c-47cb-8db4-fe8832639ef1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:18.498381 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1f31fce2-003c-47cb-8db4-fe8832639ef1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:18.640382 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1f31fce2-003c-47cb-8db4-fe8832639ef1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28622 microversion: 2.20 time: 0.163466 Oct 27 14:10:18.642425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 214/419] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:18 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28622 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:18.657484 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2cb445b8-136f-46c3-bb33-1fde494fb868 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:18.658439 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2cb445b8-136f-46c3-bb33-1fde494fb868 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:18.671397 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2cb445b8-136f-46c3-bb33-1fde494fb868 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:18.672065 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2cb445b8-136f-46c3-bb33-1fde494fb868 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:18.673072 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2cb445b8-136f-46c3-bb33-1fde494fb868 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:18.673692 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2cb445b8-136f-46c3-bb33-1fde494fb868 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:18.955909 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-23d7df06-1203-4e3c-92ec-374b24295595 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:18.963688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-23d7df06-1203-4e3c-92ec-374b24295595 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.584696 Oct 27 14:10:18.964248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 206/420] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:18 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:18.970054 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6957ceb7-dbc7-445b-994d-3631a7ab7386 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:18.970965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6957ceb7-dbc7-445b-994d-3631a7ab7386 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:18.977363 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6957ceb7-dbc7-445b-994d-3631a7ab7386 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:18.978041 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6957ceb7-dbc7-445b-994d-3631a7ab7386 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:18.978997 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6957ceb7-dbc7-445b-994d-3631a7ab7386 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:18.979468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6957ceb7-dbc7-445b-994d-3631a7ab7386 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:19.071505 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2cb445b8-136f-46c3-bb33-1fde494fb868 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:19.081250 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2cb445b8-136f-46c3-bb33-1fde494fb868 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1497 microversion: 2.1 time: 0.431674 Oct 27 14:10:19.082078 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 215/421] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:18 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1497 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:19.082828 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6957ceb7-dbc7-445b-994d-3631a7ab7386 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 31059 microversion: 2.1 time: 0.117301 Oct 27 14:10:19.086921 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 207/422] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:18 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 31059 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:19.135760 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b2c3d207-59df-4e13-8d1f-8ed7439c35ab tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:19.137137 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-b2c3d207-59df-4e13-8d1f-8ed7439c35ab tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:19.146657 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b2c3d207-59df-4e13-8d1f-8ed7439c35ab tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:19.147303 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b2c3d207-59df-4e13-8d1f-8ed7439c35ab tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:19.149025 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b2c3d207-59df-4e13-8d1f-8ed7439c35ab tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:19.149650 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b2c3d207-59df-4e13-8d1f-8ed7439c35ab tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:19.283364 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-b2c3d207-59df-4e13-8d1f-8ed7439c35ab tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:19.295552 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b2c3d207-59df-4e13-8d1f-8ed7439c35ab tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1272 microversion: 2.1 time: 0.164398 Oct 27 14:10:19.296264 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 216/423] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:19 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:19.653334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ce604457-a7cb-46c7-abff-c680054ef26b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:19.655052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ce604457-a7cb-46c7-abff-c680054ef26b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:19.662697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ce604457-a7cb-46c7-abff-c680054ef26b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:19.663403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ce604457-a7cb-46c7-abff-c680054ef26b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:19.664338 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ce604457-a7cb-46c7-abff-c680054ef26b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:19.665064 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ce604457-a7cb-46c7-abff-c680054ef26b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:19.671036 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-323adedb-3cfb-4e0e-bb21-3b811e5c1aa4 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:19.671831 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-323adedb-3cfb-4e0e-bb21-3b811e5c1aa4 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:19.680371 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-323adedb-3cfb-4e0e-bb21-3b811e5c1aa4 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:19.681486 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-323adedb-3cfb-4e0e-bb21-3b811e5c1aa4 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:19.683833 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-323adedb-3cfb-4e0e-bb21-3b811e5c1aa4 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:19.686028 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-323adedb-3cfb-4e0e-bb21-3b811e5c1aa4 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:19.728547 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-323adedb-3cfb-4e0e-bb21-3b811e5c1aa4 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Going to try to terminate instance {{(pid=115932) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:10:19.755627 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ce604457-a7cb-46c7-abff-c680054ef26b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 28622 microversion: 2.20 time: 0.105782 Oct 27 14:10:19.759371 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 208/424] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:19 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 28622 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:19.843810 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-323adedb-3cfb-4e0e-bb21-3b811e5c1aa4 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 204 len: 0 microversion: 2.1 time: 0.176136 Oct 27 14:10:19.844726 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 217/425] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:10:19 2021] DELETE /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:10:19.853534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-889fbd4c-2272-4169-9f50-4be214e36ddd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:19.854228 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-889fbd4c-2272-4169-9f50-4be214e36ddd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:19.862562 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-889fbd4c-2272-4169-9f50-4be214e36ddd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:19.863113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-889fbd4c-2272-4169-9f50-4be214e36ddd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:19.863969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-889fbd4c-2272-4169-9f50-4be214e36ddd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:19.864401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-889fbd4c-2272-4169-9f50-4be214e36ddd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:19.983248 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-74f5bdb9-c292-481e-92b2-ec8898c62e39 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:19.984049 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-74f5bdb9-c292-481e-92b2-ec8898c62e39 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:19.991935 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-74f5bdb9-c292-481e-92b2-ec8898c62e39 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:19.992169 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-74f5bdb9-c292-481e-92b2-ec8898c62e39 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:19.997157 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-74f5bdb9-c292-481e-92b2-ec8898c62e39 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:19.998175 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-74f5bdb9-c292-481e-92b2-ec8898c62e39 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:20.527654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-889fbd4c-2272-4169-9f50-4be214e36ddd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:20.535286 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-889fbd4c-2272-4169-9f50-4be214e36ddd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1503 microversion: 2.1 time: 0.685966 Oct 27 14:10:20.535861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 209/426] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:19 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1503 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:20.543502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dee9ef32-5d66-4134-b3b3-df8505d59397 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:20.543502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dee9ef32-5d66-4134-b3b3-df8505d59397 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:20.547890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dee9ef32-5d66-4134-b3b3-df8505d59397 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:20.548340 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dee9ef32-5d66-4134-b3b3-df8505d59397 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:20.549414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dee9ef32-5d66-4134-b3b3-df8505d59397 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:20.549558 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dee9ef32-5d66-4134-b3b3-df8505d59397 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:20.616497 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-74f5bdb9-c292-481e-92b2-ec8898c62e39 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:20.624796 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-74f5bdb9-c292-481e-92b2-ec8898c62e39 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.647707 Oct 27 14:10:20.635318 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 218/427] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:19 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:20.635318 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-82b54923-a882-41c0-aa69-733a6d35eacf tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:20.635318 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-82b54923-a882-41c0-aa69-733a6d35eacf tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:20.640357 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-82b54923-a882-41c0-aa69-733a6d35eacf tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:20.640803 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-82b54923-a882-41c0-aa69-733a6d35eacf tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:20.641614 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-82b54923-a882-41c0-aa69-733a6d35eacf tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:20.642042 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-82b54923-a882-41c0-aa69-733a6d35eacf tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:20.657817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dee9ef32-5d66-4134-b3b3-df8505d59397 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 32314 microversion: 2.1 time: 0.120715 Oct 27 14:10:20.659616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 210/428] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:20 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 32314 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:20.771571 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-149f380f-ce39-445b-9840-e4d8ad23627c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:20.772694 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-149f380f-ce39-445b-9840-e4d8ad23627c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:20.780830 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-149f380f-ce39-445b-9840-e4d8ad23627c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:20.781518 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-149f380f-ce39-445b-9840-e4d8ad23627c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:20.782491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-149f380f-ce39-445b-9840-e4d8ad23627c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:20.783081 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-149f380f-ce39-445b-9840-e4d8ad23627c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:20.910705 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-149f380f-ce39-445b-9840-e4d8ad23627c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 29500 microversion: 2.20 time: 0.142997 Oct 27 14:10:20.911976 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 211/429] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:20 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 29500 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:10:20.947334 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-82b54923-a882-41c0-aa69-733a6d35eacf tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:20.954990 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-82b54923-a882-41c0-aa69-733a6d35eacf tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.328883 Oct 27 14:10:20.955530 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 219/430] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:20 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:21.557935 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5f2d8904-7094-4442-91ae-d0033cb5f9db tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:21.558896 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5f2d8904-7094-4442-91ae-d0033cb5f9db tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:21.568181 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f2d8904-7094-4442-91ae-d0033cb5f9db tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:21.569402 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f2d8904-7094-4442-91ae-d0033cb5f9db tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:21.571421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f2d8904-7094-4442-91ae-d0033cb5f9db tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:21.572040 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5f2d8904-7094-4442-91ae-d0033cb5f9db tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:21.601972 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-5ce2984e-254c-4b13-8966-4e67907489e6 req-72a507d3-4d48-49d6-bcc6-06dd6510fd07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f230df78-0ca3-435f-a01f-f0012745f170", "tag": "1c004dab-7efc-41be-9627-415208808e90"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:21.603867 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:10:21.603867 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:10:21.655689 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-5ce2984e-254c-4b13-8966-4e67907489e6 req-72a507d3-4d48-49d6-bcc6-06dd6510fd07 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:21.658161 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-5ce2984e-254c-4b13-8966-4e67907489e6 req-72a507d3-4d48-49d6-bcc6-06dd6510fd07 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:21.688791 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-5ce2984e-254c-4b13-8966-4e67907489e6 req-72a507d3-4d48-49d6-bcc6-06dd6510fd07 service nova] Creating event network-changed:1c004dab-7efc-41be-9627-415208808e90 for instance f230df78-0ca3-435f-a01f-f0012745f170 on hv-cinder-81566 Oct 27 14:10:21.695499 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-5ce2984e-254c-4b13-8966-4e67907489e6 req-72a507d3-4d48-49d6-bcc6-06dd6510fd07 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100058 Oct 27 14:10:21.696634 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 220/431] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:10:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:10:21.707866 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-96c7c088-64ef-43b4-a469-6fd15574b4ae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:21.710356 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-96c7c088-64ef-43b4-a469-6fd15574b4ae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:21.726237 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-96c7c088-64ef-43b4-a469-6fd15574b4ae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:21.727654 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-96c7c088-64ef-43b4-a469-6fd15574b4ae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:21.729397 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-96c7c088-64ef-43b4-a469-6fd15574b4ae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:21.732764 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-96c7c088-64ef-43b4-a469-6fd15574b4ae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:21.970799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5f2d8904-7094-4442-91ae-d0033cb5f9db tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:21.987874 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5f2d8904-7094-4442-91ae-d0033cb5f9db tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1503 microversion: 2.1 time: 0.432503 Oct 27 14:10:21.991616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 212/432] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:21 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1503 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:22.018917 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-df96ed47-999f-4643-9101-ebb712f7b460 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:22.020077 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-df96ed47-999f-4643-9101-ebb712f7b460 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:22.035266 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df96ed47-999f-4643-9101-ebb712f7b460 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:22.035425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df96ed47-999f-4643-9101-ebb712f7b460 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:22.036135 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df96ed47-999f-4643-9101-ebb712f7b460 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:22.036567 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df96ed47-999f-4643-9101-ebb712f7b460 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:22.099705 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-96c7c088-64ef-43b4-a469-6fd15574b4ae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:22.108705 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-96c7c088-64ef-43b4-a469-6fd15574b4ae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.410585 Oct 27 14:10:22.109573 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 221/433] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:21 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:22.125444 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ec4d3530-d97b-48b3-bbbe-9eaefe1e181b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:22.126708 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ec4d3530-d97b-48b3-bbbe-9eaefe1e181b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:22.143640 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec4d3530-d97b-48b3-bbbe-9eaefe1e181b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:22.145631 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec4d3530-d97b-48b3-bbbe-9eaefe1e181b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:22.147334 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec4d3530-d97b-48b3-bbbe-9eaefe1e181b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:22.149734 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec4d3530-d97b-48b3-bbbe-9eaefe1e181b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:22.246643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-df96ed47-999f-4643-9101-ebb712f7b460 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 33798 microversion: 2.1 time: 0.253353 Oct 27 14:10:22.247306 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 213/434] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:21 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 33798 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:22.256924 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7df4ad3e-f1ad-4182-9042-145ccf6ff980 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:22.258942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7df4ad3e-f1ad-4182-9042-145ccf6ff980 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:22.271339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7df4ad3e-f1ad-4182-9042-145ccf6ff980 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:22.272407 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7df4ad3e-f1ad-4182-9042-145ccf6ff980 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:22.274135 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7df4ad3e-f1ad-4182-9042-145ccf6ff980 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:22.274891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7df4ad3e-f1ad-4182-9042-145ccf6ff980 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:22.349424 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ec4d3530-d97b-48b3-bbbe-9eaefe1e181b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 30774 microversion: 2.20 time: 0.227346 Oct 27 14:10:22.350391 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 222/435] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:22 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 30774 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:22.358639 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-693e74f4-0ae5-4b23-9139-1feed7f46e86 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e536b50c-b012-4871-b130-4b87962fe05f"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:22.360132 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-693e74f4-0ae5-4b23-9139-1feed7f46e86 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:22.372442 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-693e74f4-0ae5-4b23-9139-1feed7f46e86 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:22.374227 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-693e74f4-0ae5-4b23-9139-1feed7f46e86 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:22.375379 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-693e74f4-0ae5-4b23-9139-1feed7f46e86 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:22.376033 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-693e74f4-0ae5-4b23-9139-1feed7f46e86 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:22.518026 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-693e74f4-0ae5-4b23-9139-1feed7f46e86 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] HTTP exception thrown: Invalid volume: volume e536b50c-b012-4871-b130-4b87962fe05f is already attached to instances: 33d21e2b-a722-4824-b404-e0493b36c4d1 Oct 27 14:10:22.519075 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-693e74f4-0ae5-4b23-9139-1feed7f46e86 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Returning 400 to user: Invalid volume: volume e536b50c-b012-4871-b130-4b87962fe05f is already attached to instances: 33d21e2b-a722-4824-b404-e0493b36c4d1 {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:10:22.520120 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-693e74f4-0ae5-4b23-9139-1feed7f46e86 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "POST /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.168088 Oct 27 14:10:22.530186 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 223/436] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:10:22 2021] POST /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments => generated 174 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 14:10:22.641533 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7df4ad3e-f1ad-4182-9042-145ccf6ff980 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:22.661888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7df4ad3e-f1ad-4182-9042-145ccf6ff980 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.407735 Oct 27 14:10:22.666670 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 214/437] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:22 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:22.706440 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-10333da0-df96-4612-af47-30b58e47a9d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:22.707023 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-10333da0-df96-4612-af47-30b58e47a9d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:22.718107 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-10333da0-df96-4612-af47-30b58e47a9d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:22.718554 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-10333da0-df96-4612-af47-30b58e47a9d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:22.719851 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-10333da0-df96-4612-af47-30b58e47a9d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:22.727720 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-10333da0-df96-4612-af47-30b58e47a9d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:22.845186 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.objects.instance [None req-10333da0-df96-4612-af47-30b58e47a9d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lazy-loading 'services' on Instance uuid 33d21e2b-a722-4824-b404-e0493b36c4d1 {{(pid=115932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:10:22.997355 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-10333da0-df96-4612-af47-30b58e47a9d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments/e536b50c-b012-4871-b130-4b87962fe05f" status: 202 len: 0 microversion: 2.1 time: 0.296787 Oct 27 14:10:22.998826 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 224/438] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:10:22 2021] DELETE /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments/e536b50c-b012-4871-b130-4b87962fe05f => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:23.011439 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2917aa04-81b7-447c-8a84-74464caddbae tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:23.012346 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2917aa04-81b7-447c-8a84-74464caddbae tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:23.012942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-257bba2e-59d4-4c6b-8fd9-20f45654c90f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:23.019473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-257bba2e-59d4-4c6b-8fd9-20f45654c90f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:23.021679 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2917aa04-81b7-447c-8a84-74464caddbae tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.022283 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2917aa04-81b7-447c-8a84-74464caddbae tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.024113 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2917aa04-81b7-447c-8a84-74464caddbae tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.024945 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2917aa04-81b7-447c-8a84-74464caddbae tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.027346 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-257bba2e-59d4-4c6b-8fd9-20f45654c90f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.027965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-257bba2e-59d4-4c6b-8fd9-20f45654c90f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.029091 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-257bba2e-59d4-4c6b-8fd9-20f45654c90f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.029598 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-257bba2e-59d4-4c6b-8fd9-20f45654c90f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.114207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-257bba2e-59d4-4c6b-8fd9-20f45654c90f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108583 Oct 27 14:10:23.122247 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 215/439] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:10:23 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:23.136647 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8896c265-a20c-4276-89c8-0ada3a3fb60f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:23.138204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8896c265-a20c-4276-89c8-0ada3a3fb60f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:23.152156 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8896c265-a20c-4276-89c8-0ada3a3fb60f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.153461 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8896c265-a20c-4276-89c8-0ada3a3fb60f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.155960 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8896c265-a20c-4276-89c8-0ada3a3fb60f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.157047 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8896c265-a20c-4276-89c8-0ada3a3fb60f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.686042 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2917aa04-81b7-447c-8a84-74464caddbae tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:23.703805 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2917aa04-81b7-447c-8a84-74464caddbae tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1503 microversion: 2.1 time: 0.697152 Oct 27 14:10:23.705050 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 225/440] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:23 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1503 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:23.709980 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f65046ae-4064-45c7-b5f9-b8237bb703e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:23.711120 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f65046ae-4064-45c7-b5f9-b8237bb703e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:23.722583 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f65046ae-4064-45c7-b5f9-b8237bb703e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.723033 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f65046ae-4064-45c7-b5f9-b8237bb703e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.723882 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f65046ae-4064-45c7-b5f9-b8237bb703e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.729605 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f65046ae-4064-45c7-b5f9-b8237bb703e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.754885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8896c265-a20c-4276-89c8-0ada3a3fb60f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:23.764650 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8896c265-a20c-4276-89c8-0ada3a3fb60f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.639358 Oct 27 14:10:23.776596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 216/441] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:23 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:23.787554 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-64f45dc9-f74a-4f88-9aa6-c2151854665b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:23.788730 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-64f45dc9-f74a-4f88-9aa6-c2151854665b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:23.801726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-64f45dc9-f74a-4f88-9aa6-c2151854665b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.803788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-64f45dc9-f74a-4f88-9aa6-c2151854665b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.806084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-64f45dc9-f74a-4f88-9aa6-c2151854665b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.806533 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-64f45dc9-f74a-4f88-9aa6-c2151854665b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.922215 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f65046ae-4064-45c7-b5f9-b8237bb703e3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 34236 microversion: 2.1 time: 0.213078 Oct 27 14:10:23.922215 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 226/442] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:23 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 34236 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:23.932476 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8651de66-f0ba-4c0b-805a-4d3852e6e367 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:23.933632 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-8651de66-f0ba-4c0b-805a-4d3852e6e367 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:23.942828 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8651de66-f0ba-4c0b-805a-4d3852e6e367 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.943301 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8651de66-f0ba-4c0b-805a-4d3852e6e367 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.943414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-64f45dc9-f74a-4f88-9aa6-c2151854665b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 32272 microversion: 2.20 time: 0.165060 Oct 27 14:10:23.944253 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8651de66-f0ba-4c0b-805a-4d3852e6e367 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:23.947993 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8651de66-f0ba-4c0b-805a-4d3852e6e367 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:23.948189 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 217/443] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:23 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 32272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:24.138114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-554e3a0c-eac1-46c4-94b8-ea0f173cb34f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:24.143359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-554e3a0c-eac1-46c4-94b8-ea0f173cb34f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:24.158513 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-554e3a0c-eac1-46c4-94b8-ea0f173cb34f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:24.159266 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-554e3a0c-eac1-46c4-94b8-ea0f173cb34f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:24.160843 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-554e3a0c-eac1-46c4-94b8-ea0f173cb34f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:24.161330 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-554e3a0c-eac1-46c4-94b8-ea0f173cb34f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:24.228045 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-554e3a0c-eac1-46c4-94b8-ea0f173cb34f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097718 Oct 27 14:10:24.228810 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 218/444] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:10:24 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:10:24.354336 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-8651de66-f0ba-4c0b-805a-4d3852e6e367 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:24.365917 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-8651de66-f0ba-4c0b-805a-4d3852e6e367 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.438642 Oct 27 14:10:24.367644 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 227/445] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:23 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:24.544321 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-74a8ba2a-623d-4889-b53d-5734dfdf5a5f req-d5c972d9-8638-4441-853b-0755af86a52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c186e5da-fd06-448a-9e65-3701f44796c4", "name": "network-vif-deleted", "tag": "3be7433d-feae-4897-986b-6ca3cbba65f8"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:24.548158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:10:24.548158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:10:24.561038 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-74a8ba2a-623d-4889-b53d-5734dfdf5a5f req-d5c972d9-8638-4441-853b-0755af86a52b service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:24.561797 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-74a8ba2a-623d-4889-b53d-5734dfdf5a5f req-d5c972d9-8638-4441-853b-0755af86a52b service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:24.578522 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-74a8ba2a-623d-4889-b53d-5734dfdf5a5f req-d5c972d9-8638-4441-853b-0755af86a52b service nova] Creating event network-vif-deleted:3be7433d-feae-4897-986b-6ca3cbba65f8 for instance c186e5da-fd06-448a-9e65-3701f44796c4 on hv-cinder-81566 Oct 27 14:10:24.596800 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-74a8ba2a-623d-4889-b53d-5734dfdf5a5f req-d5c972d9-8638-4441-853b-0755af86a52b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059507 Oct 27 14:10:24.597425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 219/446] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:10:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:10:24.727033 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:24.729068 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:24.735815 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:24.736260 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:24.737042 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:24.737543 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:24.800915 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:24.801671 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:24.802397 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.objects.instance [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lazy-loading 'fault' on Instance uuid c186e5da-fd06-448a-9e65-3701f44796c4 {{(pid=115932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:10:24.802620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-655ac767-543b-4274-b480-eb79d78bbd5f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:24.804463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-655ac767-543b-4274-b480-eb79d78bbd5f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:24.824054 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-655ac767-543b-4274-b480-eb79d78bbd5f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:24.825482 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-655ac767-543b-4274-b480-eb79d78bbd5f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:24.827934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-655ac767-543b-4274-b480-eb79d78bbd5f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:24.829926 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-655ac767-543b-4274-b480-eb79d78bbd5f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:24.880212 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:24.889851 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-139d09a7-0d96-4ad7-a523-48c8f1ce061c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 200 len: 1304 microversion: 2.1 time: 0.169260 Oct 27 14:10:24.895670 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 228/447] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:24 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 1304 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:24.933797 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-6626f225-ec71-45b8-b3b2-bcb387ec6235 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:24.934981 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-6626f225-ec71-45b8-b3b2-bcb387ec6235 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:24.942501 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6626f225-ec71-45b8-b3b2-bcb387ec6235 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:24.943038 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6626f225-ec71-45b8-b3b2-bcb387ec6235 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:24.944199 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6626f225-ec71-45b8-b3b2-bcb387ec6235 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:24.944703 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6626f225-ec71-45b8-b3b2-bcb387ec6235 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.051439 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-655ac767-543b-4274-b480-eb79d78bbd5f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:25.059839 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-655ac767-543b-4274-b480-eb79d78bbd5f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1501 microversion: 2.1 time: 0.281164 Oct 27 14:10:25.060495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 220/448] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:24 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1501 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:25.066073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-387c90c3-126c-40ee-9e9f-7a1d3b9cc3f9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:25.066994 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-387c90c3-126c-40ee-9e9f-7a1d3b9cc3f9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:25.082853 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-6626f225-ec71-45b8-b3b2-bcb387ec6235 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 34651 microversion: 2.1 time: 0.153195 Oct 27 14:10:25.084930 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-387c90c3-126c-40ee-9e9f-7a1d3b9cc3f9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.085902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-387c90c3-126c-40ee-9e9f-7a1d3b9cc3f9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.087390 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-387c90c3-126c-40ee-9e9f-7a1d3b9cc3f9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.088085 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-387c90c3-126c-40ee-9e9f-7a1d3b9cc3f9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.089223 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 229/449] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:24 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 34651 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:25.097587 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-35798b8c-505a-4ae5-a923-77644e629198 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "085e6df4-d15b-4658-a21b-a300a64c0fc2"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:25.099865 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-35798b8c-505a-4ae5-a923-77644e629198 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:25.107422 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35798b8c-505a-4ae5-a923-77644e629198 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.108187 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35798b8c-505a-4ae5-a923-77644e629198 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.110082 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35798b8c-505a-4ae5-a923-77644e629198 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.111256 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35798b8c-505a-4ae5-a923-77644e629198 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.164170 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-35798b8c-505a-4ae5-a923-77644e629198 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] HTTP exception thrown: Cannot 'attach_volume' instance adbc567f-bc87-48cd-b910-ba46c84f914d while it is in vm_state rescued Oct 27 14:10:25.164170 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-35798b8c-505a-4ae5-a923-77644e629198 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Returning 409 to user: Cannot 'attach_volume' instance adbc567f-bc87-48cd-b910-ba46c84f914d while it is in vm_state rescued {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:10:25.165037 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-35798b8c-505a-4ae5-a923-77644e629198 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.073965 Oct 27 14:10:25.166295 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 230/450] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:10:25 2021] POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 14:10:25.181893 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-6aec6677-d3b7-4ca3-a3a1-e9c01f7d4c89 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:25.182918 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-6aec6677-d3b7-4ca3-a3a1-e9c01f7d4c89 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:25.197908 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6aec6677-d3b7-4ca3-a3a1-e9c01f7d4c89 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.199066 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6aec6677-d3b7-4ca3-a3a1-e9c01f7d4c89 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.201947 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6aec6677-d3b7-4ca3-a3a1-e9c01f7d4c89 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.203162 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6aec6677-d3b7-4ca3-a3a1-e9c01f7d4c89 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.240588 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-387c90c3-126c-40ee-9e9f-7a1d3b9cc3f9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 33019 microversion: 2.20 time: 0.177700 Oct 27 14:10:25.247879 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 221/451] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:25 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 33019 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:25.264197 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d86bbb7e-e5f7-4e09-8aaa-e4274a4fd971 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:25.267942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d86bbb7e-e5f7-4e09-8aaa-e4274a4fd971 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:25.308319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d86bbb7e-e5f7-4e09-8aaa-e4274a4fd971 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.309647 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d86bbb7e-e5f7-4e09-8aaa-e4274a4fd971 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.311556 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d86bbb7e-e5f7-4e09-8aaa-e4274a4fd971 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.312554 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d86bbb7e-e5f7-4e09-8aaa-e4274a4fd971 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.329916 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-6aec6677-d3b7-4ca3-a3a1-e9c01f7d4c89 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/action" status: 202 len: 0 microversion: 2.1 time: 0.155976 Oct 27 14:10:25.330875 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 231/452] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:25 2021] POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:25.348814 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-36995de7-002a-4968-a206-d666d3c396d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:25.349911 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-36995de7-002a-4968-a206-d666d3c396d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:25.370600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-36995de7-002a-4968-a206-d666d3c396d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.371873 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-36995de7-002a-4968-a206-d666d3c396d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.373525 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-36995de7-002a-4968-a206-d666d3c396d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.374672 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-36995de7-002a-4968-a206-d666d3c396d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.388780 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d86bbb7e-e5f7-4e09-8aaa-e4274a4fd971 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138102 Oct 27 14:10:25.390104 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 222/453] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:10:25 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:25.396993 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dd67e5c2-2c94-4b11-99b2-5b0a8498140b tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:25.398456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dd67e5c2-2c94-4b11-99b2-5b0a8498140b tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:25.409810 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd67e5c2-2c94-4b11-99b2-5b0a8498140b tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.410617 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd67e5c2-2c94-4b11-99b2-5b0a8498140b tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:25.411631 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd67e5c2-2c94-4b11-99b2-5b0a8498140b tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:25.412180 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dd67e5c2-2c94-4b11-99b2-5b0a8498140b tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:26.064771 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-dd67e5c2-2c94-4b11-99b2-5b0a8498140b tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:26.072499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dd67e5c2-2c94-4b11-99b2-5b0a8498140b tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.679841 Oct 27 14:10:26.083910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-36995de7-002a-4968-a206-d666d3c396d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:26.085616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 223/454] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:25 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:26.098150 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-36995de7-002a-4968-a206-d666d3c396d4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1509 microversion: 2.1 time: 0.760813 Oct 27 14:10:26.099293 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 232/455] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:25 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1509 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:26.100947 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-983ee68c-8bf4-4502-a834-75287bc94f53 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:26.102230 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-983ee68c-8bf4-4502-a834-75287bc94f53 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: c186e5da-fd06-448a-9e65-3701f44796c4] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:26.110078 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-983ee68c-8bf4-4502-a834-75287bc94f53 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:26.110515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-983ee68c-8bf4-4502-a834-75287bc94f53 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:26.111360 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-983ee68c-8bf4-4502-a834-75287bc94f53 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:26.111781 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-983ee68c-8bf4-4502-a834-75287bc94f53 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:26.112754 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ff24b1d7-87da-4223-84d9-cc8986d0e790 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:26.113858 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ff24b1d7-87da-4223-84d9-cc8986d0e790 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:26.120145 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ff24b1d7-87da-4223-84d9-cc8986d0e790 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:26.120910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ff24b1d7-87da-4223-84d9-cc8986d0e790 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:26.121869 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ff24b1d7-87da-4223-84d9-cc8986d0e790 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:26.122395 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ff24b1d7-87da-4223-84d9-cc8986d0e790 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:26.132362 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-983ee68c-8bf4-4502-a834-75287bc94f53 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] HTTP exception thrown: Instance c186e5da-fd06-448a-9e65-3701f44796c4 could not be found. Oct 27 14:10:26.133040 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-983ee68c-8bf4-4502-a834-75287bc94f53 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Returning 404 to user: Instance c186e5da-fd06-448a-9e65-3701f44796c4 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:10:26.134437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-983ee68c-8bf4-4502-a834-75287bc94f53 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4" status: 404 len: 111 microversion: 2.1 time: 0.040438 Oct 27 14:10:26.135354 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 224/456] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:26 2021] GET /compute/v2.1/servers/c186e5da-fd06-448a-9e65-3701f44796c4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:10:26.259121 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d7e59f30-393c-4866-8964-8463566ac077 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:26.260135 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ff24b1d7-87da-4223-84d9-cc8986d0e790 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 35246 microversion: 2.1 time: 0.158782 Oct 27 14:10:26.260307 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d7e59f30-393c-4866-8964-8463566ac077 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:26.260905 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 233/457] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:26 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 35246 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:26.272899 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7e59f30-393c-4866-8964-8463566ac077 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:26.273496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7e59f30-393c-4866-8964-8463566ac077 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:26.274610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7e59f30-393c-4866-8964-8463566ac077 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:26.275276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7e59f30-393c-4866-8964-8463566ac077 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:26.332438 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-322543926", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "networks": [{"uuid": "9a3a3d90-aa72-4eeb-9ef8-20afdb56ecfd"}]}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:26.413032 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.network.neutron [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] validate_networks() for [('9a3a3d90-aa72-4eeb-9ef8-20afdb56ecfd', None, None, None, None, None)] {{(pid=115932) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:10:26.426382 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d7e59f30-393c-4866-8964-8463566ac077 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 33641 microversion: 2.20 time: 0.170864 Oct 27 14:10:26.427914 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 225/458] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:26 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 33641 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:10:26.437515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d82505c3-9609-44fa-b8e2-4a463a94dde4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:26.439086 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d82505c3-9609-44fa-b8e2-4a463a94dde4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:26.447550 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d82505c3-9609-44fa-b8e2-4a463a94dde4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:26.448238 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d82505c3-9609-44fa-b8e2-4a463a94dde4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:26.449180 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d82505c3-9609-44fa-b8e2-4a463a94dde4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:26.449609 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d82505c3-9609-44fa-b8e2-4a463a94dde4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:26.488627 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d82505c3-9609-44fa-b8e2-4a463a94dde4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058162 Oct 27 14:10:26.489208 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 226/459] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:10:26 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:27.103628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-94f6dadc-bf3e-4940-b90c-3f01b7db6e68 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:27.104504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-94f6dadc-bf3e-4940-b90c-3f01b7db6e68 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:27.130575 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94f6dadc-bf3e-4940-b90c-3f01b7db6e68 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.131162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94f6dadc-bf3e-4940-b90c-3f01b7db6e68 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.132090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94f6dadc-bf3e-4940-b90c-3f01b7db6e68 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.132610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94f6dadc-bf3e-4940-b90c-3f01b7db6e68 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.151096 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Flavor limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:10:27.152249 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Image limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:10:27.152639 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Flavor pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:10:27.153338 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Image pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:10:27.153768 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:10:27.179660 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.180025 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.180839 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.181273 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.224554 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Getting quotas for project 403cbdd2f7e54a148b5f8f44b38a045d. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:10:27.229090 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Getting quotas for user 0014f5c117f04c9295a0fcdd35a6b56b and project 403cbdd2f7e54a148b5f8f44b38a045d. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:10:27.253829 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Going to run 1 instances... {{(pid=115932) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:10:27.256597 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:10:27.356923 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0d83ce9c-75cc-49a3-97bf-9b765fd45ad6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028767 Oct 27 14:10:27.375271 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 234/460] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:10:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 14:10:27.377175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-94f6dadc-bf3e-4940-b90c-3f01b7db6e68 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:27.380209 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b29b0488-32f8-49fc-ae5e-368a2a8a3516 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:27.381574 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-b29b0488-32f8-49fc-ae5e-368a2a8a3516 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:27.396514 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b29b0488-32f8-49fc-ae5e-368a2a8a3516 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.398423 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b29b0488-32f8-49fc-ae5e-368a2a8a3516 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.398423 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b29b0488-32f8-49fc-ae5e-368a2a8a3516 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.399534 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b29b0488-32f8-49fc-ae5e-368a2a8a3516 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.405491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-94f6dadc-bf3e-4940-b90c-3f01b7db6e68 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.306863 Oct 27 14:10:27.425561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 227/461] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:27 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:27.443927 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-230b99e1-49c5-4b27-8ad6-fcd461b1a49b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:27.448206 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-230b99e1-49c5-4b27-8ad6-fcd461b1a49b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:27.459912 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-230b99e1-49c5-4b27-8ad6-fcd461b1a49b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.461429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-230b99e1-49c5-4b27-8ad6-fcd461b1a49b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.463588 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-230b99e1-49c5-4b27-8ad6-fcd461b1a49b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.464776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-230b99e1-49c5-4b27-8ad6-fcd461b1a49b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.608322 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-b29b0488-32f8-49fc-ae5e-368a2a8a3516 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:27.617098 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-230b99e1-49c5-4b27-8ad6-fcd461b1a49b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 35994 microversion: 2.1 time: 0.188800 Oct 27 14:10:27.617413 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b29b0488-32f8-49fc-ae5e-368a2a8a3516 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1509 microversion: 2.1 time: 0.249717 Oct 27 14:10:27.618123 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 235/462] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:27 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:27.618338 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 228/463] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:27 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 35994 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:27.624229 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e1249b50-c7fd-4751-ad25-d744b86c94bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:27.624463 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-5ac5a2a6-24ea-4e59-8075-545e12602f8c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:27.625707 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e1249b50-c7fd-4751-ad25-d744b86c94bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:27.633855 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e1249b50-c7fd-4751-ad25-d744b86c94bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.634714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e1249b50-c7fd-4751-ad25-d744b86c94bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.635430 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-5ac5a2a6-24ea-4e59-8075-545e12602f8c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:27.636455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e1249b50-c7fd-4751-ad25-d744b86c94bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.637311 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e1249b50-c7fd-4751-ad25-d744b86c94bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.744935 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-5ac5a2a6-24ea-4e59-8075-545e12602f8c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:27.754319 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-5ac5a2a6-24ea-4e59-8075-545e12602f8c tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1213 microversion: 2.1 time: 0.134499 Oct 27 14:10:27.755319 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 236/464] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:27 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:27.762182 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-df0de0a5-080e-4b5e-87cb-120b93eabc1d tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:27.763935 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-df0de0a5-080e-4b5e-87cb-120b93eabc1d tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:27.773591 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-df0de0a5-080e-4b5e-87cb-120b93eabc1d tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.774716 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-df0de0a5-080e-4b5e-87cb-120b93eabc1d tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.779933 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-df0de0a5-080e-4b5e-87cb-120b93eabc1d tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:27.781540 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-df0de0a5-080e-4b5e-87cb-120b93eabc1d tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:27.783037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e1249b50-c7fd-4751-ad25-d744b86c94bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 34224 microversion: 2.20 time: 0.162869 Oct 27 14:10:27.789418 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 229/465] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:27 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 34224 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:27.850741 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-df0de0a5-080e-4b5e-87cb-120b93eabc1d tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092880 Oct 27 14:10:27.855563 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 237/466] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:10:27 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:28.443802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f66384d3-aad1-4dec-9575-98631aa98639 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:28.444496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f66384d3-aad1-4dec-9575-98631aa98639 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:28.455163 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f66384d3-aad1-4dec-9575-98631aa98639 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:28.456379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f66384d3-aad1-4dec-9575-98631aa98639 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:28.458043 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f66384d3-aad1-4dec-9575-98631aa98639 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:28.458722 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f66384d3-aad1-4dec-9575-98631aa98639 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:28.640942 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1b90d201-595c-4820-8466-0e1757aa7a4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:28.643906 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1b90d201-595c-4820-8466-0e1757aa7a4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:28.655441 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1b90d201-595c-4820-8466-0e1757aa7a4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:28.657510 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1b90d201-595c-4820-8466-0e1757aa7a4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:28.658776 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1b90d201-595c-4820-8466-0e1757aa7a4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:28.659498 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1b90d201-595c-4820-8466-0e1757aa7a4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:28.733364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f66384d3-aad1-4dec-9575-98631aa98639 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:28.744025 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f66384d3-aad1-4dec-9575-98631aa98639 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.304360 Oct 27 14:10:28.744921 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 230/467] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:28 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:28.750413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-209c5469-85b9-4b79-9da4-41af3f3e49bd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:28.759967 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-209c5469-85b9-4b79-9da4-41af3f3e49bd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:28.771154 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-209c5469-85b9-4b79-9da4-41af3f3e49bd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:28.772247 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-209c5469-85b9-4b79-9da4-41af3f3e49bd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:28.773777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-209c5469-85b9-4b79-9da4-41af3f3e49bd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:28.773777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-209c5469-85b9-4b79-9da4-41af3f3e49bd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:28.788326 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1b90d201-595c-4820-8466-0e1757aa7a4f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 36567 microversion: 2.1 time: 0.160250 Oct 27 14:10:28.795302 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 238/468] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:28 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 36567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:28.797035 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-bc01b1b9-0274-4081-a51e-0842909ede2e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:28.804112 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-bc01b1b9-0274-4081-a51e-0842909ede2e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:28.828442 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc01b1b9-0274-4081-a51e-0842909ede2e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:28.828940 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc01b1b9-0274-4081-a51e-0842909ede2e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:28.829602 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc01b1b9-0274-4081-a51e-0842909ede2e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:28.830067 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-bc01b1b9-0274-4081-a51e-0842909ede2e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:28.948725 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-bc01b1b9-0274-4081-a51e-0842909ede2e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:28.968603 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-bc01b1b9-0274-4081-a51e-0842909ede2e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1265 microversion: 2.1 time: 0.173590 Oct 27 14:10:28.978617 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 239/469] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:28 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:28.978617 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b7e8f38e-40bc-478b-95f1-e3eebe67fdb8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:28.978922 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-b7e8f38e-40bc-478b-95f1-e3eebe67fdb8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:29.005004 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b7e8f38e-40bc-478b-95f1-e3eebe67fdb8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:29.005796 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b7e8f38e-40bc-478b-95f1-e3eebe67fdb8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:29.010304 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b7e8f38e-40bc-478b-95f1-e3eebe67fdb8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:29.011393 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b7e8f38e-40bc-478b-95f1-e3eebe67fdb8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:29.186310 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b7e8f38e-40bc-478b-95f1-e3eebe67fdb8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 34613 microversion: 2.20 time: 0.212922 Oct 27 14:10:29.188582 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 240/470] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:28 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 34613 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:29.217882 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-9e93385b-12b3-437d-8f3f-0023f23be379 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:29.219849 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-9e93385b-12b3-437d-8f3f-0023f23be379 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:29.240435 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9e93385b-12b3-437d-8f3f-0023f23be379 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:29.242612 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9e93385b-12b3-437d-8f3f-0023f23be379 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:29.245831 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9e93385b-12b3-437d-8f3f-0023f23be379 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:29.247900 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9e93385b-12b3-437d-8f3f-0023f23be379 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:29.384933 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-209c5469-85b9-4b79-9da4-41af3f3e49bd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:29.400420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-209c5469-85b9-4b79-9da4-41af3f3e49bd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1509 microversion: 2.1 time: 0.648927 Oct 27 14:10:29.403649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 231/471] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:28 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1509 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:29.418990 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-9e93385b-12b3-437d-8f3f-0023f23be379 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221806 Oct 27 14:10:29.421853 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 241/472] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:10:29 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:29.764347 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4d36ee89-d484-459b-b9ce-54f71045b898 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:29.765509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4d36ee89-d484-459b-b9ce-54f71045b898 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:29.772597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4d36ee89-d484-459b-b9ce-54f71045b898 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:29.773044 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4d36ee89-d484-459b-b9ce-54f71045b898 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:29.773881 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4d36ee89-d484-459b-b9ce-54f71045b898 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:29.774613 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4d36ee89-d484-459b-b9ce-54f71045b898 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:29.803209 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-3bcfd93c-4a68-46e8-9ad3-d1c4feeb21f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:29.804978 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-3bcfd93c-4a68-46e8-9ad3-d1c4feeb21f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:29.814438 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3bcfd93c-4a68-46e8-9ad3-d1c4feeb21f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:29.818191 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3bcfd93c-4a68-46e8-9ad3-d1c4feeb21f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:29.819246 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3bcfd93c-4a68-46e8-9ad3-d1c4feeb21f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:29.823993 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3bcfd93c-4a68-46e8-9ad3-d1c4feeb21f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:29.976096 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-3bcfd93c-4a68-46e8-9ad3-d1c4feeb21f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 37091 microversion: 2.1 time: 0.175970 Oct 27 14:10:29.980982 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 242/473] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:29 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 37091 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:29.994615 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-570229a8-da50-4d35-9e92-f605f5b0ac8a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:29.995489 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-570229a8-da50-4d35-9e92-f605f5b0ac8a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:30.016962 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-570229a8-da50-4d35-9e92-f605f5b0ac8a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:30.017429 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-570229a8-da50-4d35-9e92-f605f5b0ac8a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:30.018243 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-570229a8-da50-4d35-9e92-f605f5b0ac8a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:30.019824 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-570229a8-da50-4d35-9e92-f605f5b0ac8a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:30.175180 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-570229a8-da50-4d35-9e92-f605f5b0ac8a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:30.188309 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-570229a8-da50-4d35-9e92-f605f5b0ac8a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1271 microversion: 2.1 time: 0.202557 Oct 27 14:10:30.195982 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 243/474] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:29 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:30.229625 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-480fabfb-9dce-4b40-af8c-9340900cde38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:30.230653 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-480fabfb-9dce-4b40-af8c-9340900cde38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:30.241715 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-480fabfb-9dce-4b40-af8c-9340900cde38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:30.242276 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-480fabfb-9dce-4b40-af8c-9340900cde38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:30.243382 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-480fabfb-9dce-4b40-af8c-9340900cde38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:30.244036 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-480fabfb-9dce-4b40-af8c-9340900cde38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:30.323123 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4d36ee89-d484-459b-b9ce-54f71045b898 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:30.350178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4d36ee89-d484-459b-b9ce-54f71045b898 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.589757 Oct 27 14:10:30.368976 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 232/475] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:29 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:30.417555 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-480fabfb-9dce-4b40-af8c-9340900cde38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 35029 microversion: 2.20 time: 0.216988 Oct 27 14:10:30.418225 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 244/476] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:30 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 35029 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:30.431017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a11a8917-d568-4994-b618-2590cec66adb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:30.431692 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a11a8917-d568-4994-b618-2590cec66adb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:30.451006 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-9d8b9988-0c8f-4687-b3ab-d06a681c9fb6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:30.452191 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-9d8b9988-0c8f-4687-b3ab-d06a681c9fb6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:30.474545 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a11a8917-d568-4994-b618-2590cec66adb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:30.475072 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a11a8917-d568-4994-b618-2590cec66adb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:30.475940 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a11a8917-d568-4994-b618-2590cec66adb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:30.495078 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9d8b9988-0c8f-4687-b3ab-d06a681c9fb6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:30.495512 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a11a8917-d568-4994-b618-2590cec66adb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:30.500165 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9d8b9988-0c8f-4687-b3ab-d06a681c9fb6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:30.501638 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9d8b9988-0c8f-4687-b3ab-d06a681c9fb6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:30.502316 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9d8b9988-0c8f-4687-b3ab-d06a681c9fb6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:30.723602 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-9d8b9988-0c8f-4687-b3ab-d06a681c9fb6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.288046 Oct 27 14:10:30.729462 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 245/477] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:10:30 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1/os-volume_attachments => generated 25 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 14:10:30.996048 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7544f6ce-f035-422c-a3ef-3aa8a3f58f37 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:30.999697 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7544f6ce-f035-422c-a3ef-3aa8a3f58f37 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:31.030600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7544f6ce-f035-422c-a3ef-3aa8a3f58f37 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:31.036204 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7544f6ce-f035-422c-a3ef-3aa8a3f58f37 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:31.040626 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7544f6ce-f035-422c-a3ef-3aa8a3f58f37 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:31.042898 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7544f6ce-f035-422c-a3ef-3aa8a3f58f37 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:31.193901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a11a8917-d568-4994-b618-2590cec66adb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:31.202651 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7544f6ce-f035-422c-a3ef-3aa8a3f58f37 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 37894 microversion: 2.1 time: 0.216922 Oct 27 14:10:31.204777 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 246/478] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:30 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 37894 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:10:31.208477 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a11a8917-d568-4994-b618-2590cec66adb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1515 microversion: 2.1 time: 0.777473 Oct 27 14:10:31.209459 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 233/479] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:30 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1515 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:31.214595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-79f471c1-27ad-44f1-8863-1299eb0de41f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:31.218966 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1596519780", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "networks": [{"uuid": "5b53c648-0313-4179-8334-9fa5d1933987"}]}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:31.220160 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-79f471c1-27ad-44f1-8863-1299eb0de41f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:31.239380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-79f471c1-27ad-44f1-8863-1299eb0de41f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:31.240132 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-79f471c1-27ad-44f1-8863-1299eb0de41f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:31.241264 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-79f471c1-27ad-44f1-8863-1299eb0de41f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:31.241953 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-79f471c1-27ad-44f1-8863-1299eb0de41f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:31.376680 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.network.neutron [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] validate_networks() for [('5b53c648-0313-4179-8334-9fa5d1933987', None, None, None, None, None)] {{(pid=115932) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:10:31.585508 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-79f471c1-27ad-44f1-8863-1299eb0de41f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:31.610932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-79f471c1-27ad-44f1-8863-1299eb0de41f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1271 microversion: 2.1 time: 0.399795 Oct 27 14:10:31.624890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 234/480] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:31 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1271 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:31.635762 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d67e3955-05b1-41e9-ae5f-973ba547b722 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:31.637216 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d67e3955-05b1-41e9-ae5f-973ba547b722 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:31.664914 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d67e3955-05b1-41e9-ae5f-973ba547b722 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:31.666455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d67e3955-05b1-41e9-ae5f-973ba547b722 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:31.668003 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d67e3955-05b1-41e9-ae5f-973ba547b722 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:31.669969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d67e3955-05b1-41e9-ae5f-973ba547b722 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:32.460071 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d67e3955-05b1-41e9-ae5f-973ba547b722 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:32.472494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d67e3955-05b1-41e9-ae5f-973ba547b722 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.856162 Oct 27 14:10:32.473088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 235/481] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:31 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:32.479088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0d76bccf-5c1b-4f67-9100-e931e64c24e8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:32.480605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0d76bccf-5c1b-4f67-9100-e931e64c24e8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:32.487179 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d76bccf-5c1b-4f67-9100-e931e64c24e8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:32.488136 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d76bccf-5c1b-4f67-9100-e931e64c24e8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:32.489003 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d76bccf-5c1b-4f67-9100-e931e64c24e8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:32.489493 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d76bccf-5c1b-4f67-9100-e931e64c24e8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:33.162801 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Flavor limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:10:33.163350 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Image limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:10:33.163993 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Flavor pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:10:33.164501 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Image pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:10:33.165142 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:10:33.179513 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:33.180016 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:33.180983 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:33.181348 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:33.212545 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Getting quotas for project a55431e3db544b7980c81c6303d1e8b2. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:10:33.217563 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Getting quotas for user 3e59b470cb41474bb92d7e1049d02e6f and project a55431e3db544b7980c81c6303d1e8b2. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:10:33.238864 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Going to run 1 instances... {{(pid=115932) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:10:33.242916 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:10:33.306004 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e4ff1cdf-eb17-475b-b326-7169b511371f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.099798 Oct 27 14:10:33.308496 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 247/482] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:10:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 2104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:10:33.315376 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-13d9bf76-7ac7-4f82-bd63-e4da3ef6b114 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:33.317613 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-13d9bf76-7ac7-4f82-bd63-e4da3ef6b114 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:33.328489 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-13d9bf76-7ac7-4f82-bd63-e4da3ef6b114 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:33.329261 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-13d9bf76-7ac7-4f82-bd63-e4da3ef6b114 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:33.330070 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-13d9bf76-7ac7-4f82-bd63-e4da3ef6b114 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:33.330507 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-13d9bf76-7ac7-4f82-bd63-e4da3ef6b114 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:34.555242 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0d76bccf-5c1b-4f67-9100-e931e64c24e8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 37289 microversion: 2.20 time: 2.080227 Oct 27 14:10:34.557793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 236/483] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:32 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 37289 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:34.567897 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-97cd628c-4671-4ab4-aa4e-2747b0224bd5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:34.568959 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-97cd628c-4671-4ab4-aa4e-2747b0224bd5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:34.587499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-97cd628c-4671-4ab4-aa4e-2747b0224bd5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:34.588487 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-97cd628c-4671-4ab4-aa4e-2747b0224bd5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:34.589694 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-97cd628c-4671-4ab4-aa4e-2747b0224bd5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:34.590502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-97cd628c-4671-4ab4-aa4e-2747b0224bd5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:34.602343 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-13d9bf76-7ac7-4f82-bd63-e4da3ef6b114 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 38107 microversion: 2.1 time: 1.292184 Oct 27 14:10:34.603498 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 248/484] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:33 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 38107 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:34.624373 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-6eb27c5f-9ad5-46db-a8a0-cd72792aa6f7 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:34.626568 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-6eb27c5f-9ad5-46db-a8a0-cd72792aa6f7 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:34.644971 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6eb27c5f-9ad5-46db-a8a0-cd72792aa6f7 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:34.646023 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6eb27c5f-9ad5-46db-a8a0-cd72792aa6f7 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:34.655121 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6eb27c5f-9ad5-46db-a8a0-cd72792aa6f7 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:34.656522 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6eb27c5f-9ad5-46db-a8a0-cd72792aa6f7 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:34.793168 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-6eb27c5f-9ad5-46db-a8a0-cd72792aa6f7 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:34.804115 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-6eb27c5f-9ad5-46db-a8a0-cd72792aa6f7 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1214 microversion: 2.1 time: 0.197501 Oct 27 14:10:34.804711 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 249/485] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:34 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:34.810970 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-726df0c6-9d29-4768-865e-5102c8cb949c tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:34.815794 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-726df0c6-9d29-4768-865e-5102c8cb949c tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:34.827854 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-726df0c6-9d29-4768-865e-5102c8cb949c tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:34.828788 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-726df0c6-9d29-4768-865e-5102c8cb949c tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:34.829868 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-726df0c6-9d29-4768-865e-5102c8cb949c tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:34.830498 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-726df0c6-9d29-4768-865e-5102c8cb949c tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:35.015262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-97cd628c-4671-4ab4-aa4e-2747b0224bd5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:35.029078 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-97cd628c-4671-4ab4-aa4e-2747b0224bd5 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.469535 Oct 27 14:10:35.030852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 237/486] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:34 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:35.089353 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-726df0c6-9d29-4768-865e-5102c8cb949c tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:35.101545 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-726df0c6-9d29-4768-865e-5102c8cb949c tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.294878 Oct 27 14:10:35.102602 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 250/487] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:34 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:35.108714 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-abf6f8e7-c4d4-46c9-828c-8dced8507985 req-b87c3bcc-adb9-4118-84d9-7ca3ee8179c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f230df78-0ca3-435f-a01f-f0012745f170", "name": "network-vif-plugged", "status": "completed", "tag": "1c004dab-7efc-41be-9627-415208808e90"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:35.110610 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:10:35.110610 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:10:35.119075 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-abf6f8e7-c4d4-46c9-828c-8dced8507985 req-b87c3bcc-adb9-4118-84d9-7ca3ee8179c6 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:35.119839 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-abf6f8e7-c4d4-46c9-828c-8dced8507985 req-b87c3bcc-adb9-4118-84d9-7ca3ee8179c6 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:35.139590 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-abf6f8e7-c4d4-46c9-828c-8dced8507985 req-b87c3bcc-adb9-4118-84d9-7ca3ee8179c6 service nova] Creating event network-vif-plugged:1c004dab-7efc-41be-9627-415208808e90 for instance f230df78-0ca3-435f-a01f-f0012745f170 on hv-cinder-81566 Oct 27 14:10:35.146304 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-abf6f8e7-c4d4-46c9-828c-8dced8507985 req-b87c3bcc-adb9-4118-84d9-7ca3ee8179c6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042027 Oct 27 14:10:35.147685 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 251/488] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:10:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:35.153478 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e7b9d908-6e77-4aed-ba22-950ca68b0afe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:35.155351 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e7b9d908-6e77-4aed-ba22-950ca68b0afe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:35.162361 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e7b9d908-6e77-4aed-ba22-950ca68b0afe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:35.163298 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e7b9d908-6e77-4aed-ba22-950ca68b0afe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:35.164290 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e7b9d908-6e77-4aed-ba22-950ca68b0afe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:35.164895 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e7b9d908-6e77-4aed-ba22-950ca68b0afe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:35.479701 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-115f3c7c-8ecc-4251-b1b9-412834cb7600 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Action: 'create', calling method: .version_select at 0x7f4570a6b0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1521029144"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:35.589133 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-115f3c7c-8ecc-4251-b1b9-412834cb7600 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Getting quotas for project 925d32172c5f44168c2eddeffc0a7da1. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:10:35.624403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-115f3c7c-8ecc-4251-b1b9-412834cb7600 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Getting quotas for user aa9c479260384120a439e7f8c2dd122f and project 925d32172c5f44168c2eddeffc0a7da1. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:10:35.793794 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e7b9d908-6e77-4aed-ba22-950ca68b0afe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:35.809274 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e7b9d908-6e77-4aed-ba22-950ca68b0afe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1515 microversion: 2.1 time: 0.659096 Oct 27 14:10:35.810159 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 252/489] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:35 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1515 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:35.833258 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-425be704-7817-414f-a58b-820f854db9f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:35.834929 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-425be704-7817-414f-a58b-820f854db9f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:35.845401 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-425be704-7817-414f-a58b-820f854db9f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:35.847071 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-425be704-7817-414f-a58b-820f854db9f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:35.849280 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-425be704-7817-414f-a58b-820f854db9f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:35.850029 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-425be704-7817-414f-a58b-820f854db9f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:35.866203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-115f3c7c-8ecc-4251-b1b9-412834cb7600 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Getting quotas for project 925d32172c5f44168c2eddeffc0a7da1. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:10:35.874245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-115f3c7c-8ecc-4251-b1b9-412834cb7600 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Getting quotas for user aa9c479260384120a439e7f8c2dd122f and project 925d32172c5f44168c2eddeffc0a7da1. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:10:35.893401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-115f3c7c-8ecc-4251-b1b9-412834cb7600 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.861169 Oct 27 14:10:35.894208 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 238/490] 10.222.0.85 () {60 vars in 1157 bytes} [Wed Oct 27 14:10:35 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:35.907320 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3687d825-89e7-49b3-909a-0690b56a8a97 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:35.909082 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3687d825-89e7-49b3-909a-0690b56a8a97 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:35.916191 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3687d825-89e7-49b3-909a-0690b56a8a97 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:35.917551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3687d825-89e7-49b3-909a-0690b56a8a97 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:35.918590 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3687d825-89e7-49b3-909a-0690b56a8a97 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:35.919237 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3687d825-89e7-49b3-909a-0690b56a8a97 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:39.504622 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3687d825-89e7-49b3-909a-0690b56a8a97 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 200 len: 38238 microversion: 2.1 time: 3.608538 Oct 27 14:10:39.506514 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 239/491] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:35 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 38238 bytes in 3611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:39.512459 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-95be91b2-28d8-4262-bd2b-2e8906f49f23 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:39.513241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-95be91b2-28d8-4262-bd2b-2e8906f49f23 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:39.521024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-95be91b2-28d8-4262-bd2b-2e8906f49f23 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:39.521460 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-95be91b2-28d8-4262-bd2b-2e8906f49f23 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:39.522257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-95be91b2-28d8-4262-bd2b-2e8906f49f23 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:39.522678 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-95be91b2-28d8-4262-bd2b-2e8906f49f23 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:39.536601 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-425be704-7817-414f-a58b-820f854db9f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 38097 microversion: 2.20 time: 3.722874 Oct 27 14:10:39.538283 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 253/492] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:35 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 38097 bytes in 3727 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:39.544327 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-50f1a749-9d28-4d23-8bd0-43aefdc83fc3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61bb5062-3b9f-4d73-86f4-804c02cb5486"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:39.546624 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-50f1a749-9d28-4d23-8bd0-43aefdc83fc3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:39.554459 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-50f1a749-9d28-4d23-8bd0-43aefdc83fc3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:39.555491 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-50f1a749-9d28-4d23-8bd0-43aefdc83fc3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:39.556568 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-50f1a749-9d28-4d23-8bd0-43aefdc83fc3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:39.557173 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-50f1a749-9d28-4d23-8bd0-43aefdc83fc3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:39.912122 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-95be91b2-28d8-4262-bd2b-2e8906f49f23 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:39.940816 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-95be91b2-28d8-4262-bd2b-2e8906f49f23 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.431675 Oct 27 14:10:39.944012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 240/493] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:39 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:39.950420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-66629a5c-b73e-44a5-86da-07644809e97b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:39.952215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-66629a5c-b73e-44a5-86da-07644809e97b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:39.971957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66629a5c-b73e-44a5-86da-07644809e97b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:39.972513 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66629a5c-b73e-44a5-86da-07644809e97b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:39.973878 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66629a5c-b73e-44a5-86da-07644809e97b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:39.975386 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66629a5c-b73e-44a5-86da-07644809e97b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:39.978132 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-50f1a749-9d28-4d23-8bd0-43aefdc83fc3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435792 Oct 27 14:10:39.989218 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 254/494] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:10:39 2021] POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:40.012128 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-6fc40664-b31c-4205-bacc-1dd46b2d0f74 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:40.013231 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-6fc40664-b31c-4205-bacc-1dd46b2d0f74 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:40.037293 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6fc40664-b31c-4205-bacc-1dd46b2d0f74 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:40.038624 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6fc40664-b31c-4205-bacc-1dd46b2d0f74 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:40.039740 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6fc40664-b31c-4205-bacc-1dd46b2d0f74 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:40.040616 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6fc40664-b31c-4205-bacc-1dd46b2d0f74 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:40.720418 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-66629a5c-b73e-44a5-86da-07644809e97b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:40.726680 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-6fc40664-b31c-4205-bacc-1dd46b2d0f74 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:40.736152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-66629a5c-b73e-44a5-86da-07644809e97b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.790422 Oct 27 14:10:40.736728 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 241/495] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:39 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:40.740068 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-6fc40664-b31c-4205-bacc-1dd46b2d0f74 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.742611 Oct 27 14:10:40.741194 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 255/496] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:39 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:40.745999 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0755eafd-f995-4b5f-8c62-c30cc372547a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:40.746674 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0755eafd-f995-4b5f-8c62-c30cc372547a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:40.752927 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-047881c1-1e7d-4186-b90b-1eee79f13f9b req-0233bb3c-2e02-4984-b08b-aacb9ec05625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ac8a9f0-8970-4d42-ade8-af16e757483e", "tag": "b83fd332-cfa0-4727-9d5c-ceea41e4f808"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:40.754222 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0755eafd-f995-4b5f-8c62-c30cc372547a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:40.754671 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0755eafd-f995-4b5f-8c62-c30cc372547a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:40.755630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:10:40.755630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:10:40.755816 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0755eafd-f995-4b5f-8c62-c30cc372547a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:40.756163 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0755eafd-f995-4b5f-8c62-c30cc372547a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:40.763028 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-047881c1-1e7d-4186-b90b-1eee79f13f9b req-0233bb3c-2e02-4984-b08b-aacb9ec05625 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:40.763562 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-047881c1-1e7d-4186-b90b-1eee79f13f9b req-0233bb3c-2e02-4984-b08b-aacb9ec05625 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:40.777524 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-047881c1-1e7d-4186-b90b-1eee79f13f9b req-0233bb3c-2e02-4984-b08b-aacb9ec05625 service nova] Creating event network-changed:b83fd332-cfa0-4727-9d5c-ceea41e4f808 for instance 3ac8a9f0-8970-4d42-ade8-af16e757483e on hv-cinder-81566 Oct 27 14:10:40.783670 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-047881c1-1e7d-4186-b90b-1eee79f13f9b req-0233bb3c-2e02-4984-b08b-aacb9ec05625 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045512 Oct 27 14:10:40.784589 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 242/497] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:10:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:40.786983 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0755eafd-f995-4b5f-8c62-c30cc372547a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/ips" status: 200 len: 144 microversion: 2.1 time: 0.044593 Oct 27 14:10:40.787591 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 256/498] 10.222.0.85 () {58 vars in 1247 bytes} [Wed Oct 27 14:10:40 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/ips => generated 144 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:40.800744 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d2f1c503-5354-43f1-8971-8fc8b6b5ee81 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:40.802052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d2f1c503-5354-43f1-8971-8fc8b6b5ee81 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:40.810754 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d2f1c503-5354-43f1-8971-8fc8b6b5ee81 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:40.811234 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d2f1c503-5354-43f1-8971-8fc8b6b5ee81 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:40.811930 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d2f1c503-5354-43f1-8971-8fc8b6b5ee81 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:40.812371 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d2f1c503-5354-43f1-8971-8fc8b6b5ee81 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:40.968630 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-33ec4418-0265-4fa7-af24-d0620ca6adc9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:40.969248 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-33ec4418-0265-4fa7-af24-d0620ca6adc9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:40.975847 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-33ec4418-0265-4fa7-af24-d0620ca6adc9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:40.976300 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-33ec4418-0265-4fa7-af24-d0620ca6adc9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:40.977089 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-33ec4418-0265-4fa7-af24-d0620ca6adc9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:40.977524 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-33ec4418-0265-4fa7-af24-d0620ca6adc9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:41.120058 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-33ec4418-0265-4fa7-af24-d0620ca6adc9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:41.128356 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-33ec4418-0265-4fa7-af24-d0620ca6adc9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.163572 Oct 27 14:10:41.129142 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 257/499] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:40 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:41.754701 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d35a3f31-a1c6-41c4-9943-8d4b8f80522f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:41.755624 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d35a3f31-a1c6-41c4-9943-8d4b8f80522f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:41.761671 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d35a3f31-a1c6-41c4-9943-8d4b8f80522f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:41.762115 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d35a3f31-a1c6-41c4-9943-8d4b8f80522f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:41.762897 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d35a3f31-a1c6-41c4-9943-8d4b8f80522f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:41.763354 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d35a3f31-a1c6-41c4-9943-8d4b8f80522f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:41.896533 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-d35a3f31-a1c6-41c4-9943-8d4b8f80522f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:41.904047 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d35a3f31-a1c6-41c4-9943-8d4b8f80522f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.153554 Oct 27 14:10:41.905380 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 258/500] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:41 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:41.909895 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-5ba2e6c6-3db4-4cce-aa6d-da0aaae1b9a2 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:41.910259 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-5ba2e6c6-3db4-4cce-aa6d-da0aaae1b9a2 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:41.916934 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5ba2e6c6-3db4-4cce-aa6d-da0aaae1b9a2 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:41.917383 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5ba2e6c6-3db4-4cce-aa6d-da0aaae1b9a2 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:41.918154 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5ba2e6c6-3db4-4cce-aa6d-da0aaae1b9a2 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:41.918603 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5ba2e6c6-3db4-4cce-aa6d-da0aaae1b9a2 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:42.048163 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-5ba2e6c6-3db4-4cce-aa6d-da0aaae1b9a2 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:42.055798 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-5ba2e6c6-3db4-4cce-aa6d-da0aaae1b9a2 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.149455 Oct 27 14:10:42.056420 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 259/501] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:41 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:42.145972 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c785d1a4-2510-45fc-96b6-7b3df9eb473b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:42.146579 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c785d1a4-2510-45fc-96b6-7b3df9eb473b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:42.152807 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c785d1a4-2510-45fc-96b6-7b3df9eb473b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:42.153247 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c785d1a4-2510-45fc-96b6-7b3df9eb473b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:42.154019 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c785d1a4-2510-45fc-96b6-7b3df9eb473b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:42.155479 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c785d1a4-2510-45fc-96b6-7b3df9eb473b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:42.286981 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c785d1a4-2510-45fc-96b6-7b3df9eb473b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:42.294268 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c785d1a4-2510-45fc-96b6-7b3df9eb473b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.152116 Oct 27 14:10:42.294962 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 260/502] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:42 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:42.800338 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-0d3a3239-858f-4345-ae5e-089c9f0c4bce req-73e61107-e3d8-43b9-91a7-2aa1184d295d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17894aa2-3d8b-4ce1-bd00-92e52c1825f0", "tag": "3d0109dd-8bb8-434e-a4b1-7a4b1d7ad578"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:42.801908 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:10:42.801908 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:10:42.808710 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-0d3a3239-858f-4345-ae5e-089c9f0c4bce req-73e61107-e3d8-43b9-91a7-2aa1184d295d service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:42.809150 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-0d3a3239-858f-4345-ae5e-089c9f0c4bce req-73e61107-e3d8-43b9-91a7-2aa1184d295d service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:42.819932 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-0d3a3239-858f-4345-ae5e-089c9f0c4bce req-73e61107-e3d8-43b9-91a7-2aa1184d295d service nova] Creating event network-changed:3d0109dd-8bb8-434e-a4b1-7a4b1d7ad578 for instance 17894aa2-3d8b-4ce1-bd00-92e52c1825f0 on hv-cinder-81566 Oct 27 14:10:42.824544 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-0d3a3239-858f-4345-ae5e-089c9f0c4bce req-73e61107-e3d8-43b9-91a7-2aa1184d295d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027833 Oct 27 14:10:42.825121 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 261/503] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:10:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:10:42.922403 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2c386fca-ea7b-4409-af60-899e3d6a5a0a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:42.923443 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2c386fca-ea7b-4409-af60-899e3d6a5a0a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:42.930497 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2c386fca-ea7b-4409-af60-899e3d6a5a0a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:42.930939 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2c386fca-ea7b-4409-af60-899e3d6a5a0a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:42.931776 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2c386fca-ea7b-4409-af60-899e3d6a5a0a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:42.932203 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2c386fca-ea7b-4409-af60-899e3d6a5a0a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:43.062667 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2c386fca-ea7b-4409-af60-899e3d6a5a0a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:43.070036 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2c386fca-ea7b-4409-af60-899e3d6a5a0a tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.151949 Oct 27 14:10:43.070591 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 262/504] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:42 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:43.074885 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f9aa3e48-b595-4e52-a286-bb0a01af8249 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:43.075513 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f9aa3e48-b595-4e52-a286-bb0a01af8249 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:43.081619 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f9aa3e48-b595-4e52-a286-bb0a01af8249 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:43.082059 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f9aa3e48-b595-4e52-a286-bb0a01af8249 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:43.082817 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f9aa3e48-b595-4e52-a286-bb0a01af8249 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:43.083267 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f9aa3e48-b595-4e52-a286-bb0a01af8249 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:43.208203 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-f9aa3e48-b595-4e52-a286-bb0a01af8249 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:43.215518 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f9aa3e48-b595-4e52-a286-bb0a01af8249 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.143793 Oct 27 14:10:43.216100 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 263/505] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:43 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:43.311454 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1c8b413f-c545-4213-ab4b-83e7117826fe tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:43.311997 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1c8b413f-c545-4213-ab4b-83e7117826fe tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:43.317795 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c8b413f-c545-4213-ab4b-83e7117826fe tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:43.318234 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c8b413f-c545-4213-ab4b-83e7117826fe tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:43.318989 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c8b413f-c545-4213-ab4b-83e7117826fe tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:43.319432 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1c8b413f-c545-4213-ab4b-83e7117826fe tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:43.441849 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1c8b413f-c545-4213-ab4b-83e7117826fe tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:43.449112 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1c8b413f-c545-4213-ab4b-83e7117826fe tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.141814 Oct 27 14:10:43.449673 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 264/506] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:43 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:44.088247 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-5bb772d2-56aa-48e4-bd4e-6a9141102981 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:44.088247 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-5bb772d2-56aa-48e4-bd4e-6a9141102981 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:44.092220 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d2f1c503-5354-43f1-8971-8fc8b6b5ee81 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 200 len: 38237 microversion: 2.20 time: 3.305628 Oct 27 14:10:44.092928 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 243/507] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:40 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 38237 bytes in 3308 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:44.094821 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5bb772d2-56aa-48e4-bd4e-6a9141102981 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:44.095293 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5bb772d2-56aa-48e4-bd4e-6a9141102981 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:44.096064 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5bb772d2-56aa-48e4-bd4e-6a9141102981 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:44.096495 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5bb772d2-56aa-48e4-bd4e-6a9141102981 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:44.107749 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5fffe6c2-d91b-42a4-8e53-a647b767ef79 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:44.108904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5fffe6c2-d91b-42a4-8e53-a647b767ef79 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:44.122801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5fffe6c2-d91b-42a4-8e53-a647b767ef79 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:44.124078 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5fffe6c2-d91b-42a4-8e53-a647b767ef79 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:44.124862 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5fffe6c2-d91b-42a4-8e53-a647b767ef79 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:44.125472 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5fffe6c2-d91b-42a4-8e53-a647b767ef79 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:44.150168 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5fffe6c2-d91b-42a4-8e53-a647b767ef79 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/ips" status: 200 len: 152 microversion: 2.20 time: 0.050354 Oct 27 14:10:44.150752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 244/508] 10.222.0.85 () {60 vars in 1288 bytes} [Wed Oct 27 14:10:44 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:10:44.232945 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1b6dee2b-fb84-4f01-896a-c423a39d67b3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:44.233981 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1b6dee2b-fb84-4f01-896a-c423a39d67b3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:44.240639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b6dee2b-fb84-4f01-896a-c423a39d67b3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:44.241117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b6dee2b-fb84-4f01-896a-c423a39d67b3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:44.241897 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b6dee2b-fb84-4f01-896a-c423a39d67b3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:44.242325 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b6dee2b-fb84-4f01-896a-c423a39d67b3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:44.589284 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-5bb772d2-56aa-48e4-bd4e-6a9141102981 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:44.597878 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-5bb772d2-56aa-48e4-bd4e-6a9141102981 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.514207 Oct 27 14:10:44.608843 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 265/509] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:44 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:44.613419 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a9566fab-ac33-4d1c-8fd0-c843992a49ae tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:44.614223 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a9566fab-ac33-4d1c-8fd0-c843992a49ae tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:44.621059 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a9566fab-ac33-4d1c-8fd0-c843992a49ae tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:44.621678 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a9566fab-ac33-4d1c-8fd0-c843992a49ae tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:44.622645 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a9566fab-ac33-4d1c-8fd0-c843992a49ae tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:44.623363 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a9566fab-ac33-4d1c-8fd0-c843992a49ae tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:44.626435 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1b6dee2b-fb84-4f01-896a-c423a39d67b3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:44.641488 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1b6dee2b-fb84-4f01-896a-c423a39d67b3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1314 microversion: 2.1 time: 0.411695 Oct 27 14:10:44.643684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 245/510] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:44 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:44.943779 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a9566fab-ac33-4d1c-8fd0-c843992a49ae tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:44.952554 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a9566fab-ac33-4d1c-8fd0-c843992a49ae tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.342537 Oct 27 14:10:44.953409 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 266/511] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:44 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:45.621785 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bab8c10e-572f-4a74-9160-d586c9d99b4e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:45.622628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-bab8c10e-572f-4a74-9160-d586c9d99b4e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:45.632332 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bab8c10e-572f-4a74-9160-d586c9d99b4e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:45.632961 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bab8c10e-572f-4a74-9160-d586c9d99b4e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:45.633902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bab8c10e-572f-4a74-9160-d586c9d99b4e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:45.634615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bab8c10e-572f-4a74-9160-d586c9d99b4e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:45.661494 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-35a308b9-0676-4bd8-90e6-c24628cd43a8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:45.662724 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-35a308b9-0676-4bd8-90e6-c24628cd43a8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:45.669323 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35a308b9-0676-4bd8-90e6-c24628cd43a8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:45.669846 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35a308b9-0676-4bd8-90e6-c24628cd43a8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:45.672233 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35a308b9-0676-4bd8-90e6-c24628cd43a8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:45.672690 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-35a308b9-0676-4bd8-90e6-c24628cd43a8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:45.815102 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bab8c10e-572f-4a74-9160-d586c9d99b4e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:45.825050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bab8c10e-572f-4a74-9160-d586c9d99b4e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.209228 Oct 27 14:10:45.826825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 246/512] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:45 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:45.845728 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-35a308b9-0676-4bd8-90e6-c24628cd43a8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:45.853303 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-35a308b9-0676-4bd8-90e6-c24628cd43a8 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1464 microversion: 2.1 time: 0.196641 Oct 27 14:10:45.853867 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 267/513] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:45 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1464 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:45.895110 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-129eca95-d399-4772-990f-48cfd4cc2c64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:45.895741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-129eca95-d399-4772-990f-48cfd4cc2c64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:45.905394 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-129eca95-d399-4772-990f-48cfd4cc2c64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:45.905850 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-129eca95-d399-4772-990f-48cfd4cc2c64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:45.906714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-129eca95-d399-4772-990f-48cfd4cc2c64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:45.907186 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-129eca95-d399-4772-990f-48cfd4cc2c64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:45.941004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-129eca95-d399-4772-990f-48cfd4cc2c64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:10:45.965170 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-11b40658-e4b6-4ca7-bc4f-7ffeac8e898d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03ff9056-eaf2-49ef-8796-080c53bc4dba"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:45.965170 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-11b40658-e4b6-4ca7-bc4f-7ffeac8e898d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:45.972762 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-11b40658-e4b6-4ca7-bc4f-7ffeac8e898d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:45.973509 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-11b40658-e4b6-4ca7-bc4f-7ffeac8e898d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:45.974877 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-11b40658-e4b6-4ca7-bc4f-7ffeac8e898d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:45.975799 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-11b40658-e4b6-4ca7-bc4f-7ffeac8e898d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:46.064138 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-129eca95-d399-4772-990f-48cfd4cc2c64 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 204 len: 0 microversion: 2.1 time: 0.173465 Oct 27 14:10:46.068601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 247/514] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:10:45 2021] DELETE /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:10:46.069895 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-705144c2-0c41-480b-8c01-6e37aa17a8c9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:46.070595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-705144c2-0c41-480b-8c01-6e37aa17a8c9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:46.078122 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-705144c2-0c41-480b-8c01-6e37aa17a8c9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:46.078686 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-705144c2-0c41-480b-8c01-6e37aa17a8c9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:46.079564 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-705144c2-0c41-480b-8c01-6e37aa17a8c9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:46.079822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-705144c2-0c41-480b-8c01-6e37aa17a8c9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:46.229425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-705144c2-0c41-480b-8c01-6e37aa17a8c9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:46.241177 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-705144c2-0c41-480b-8c01-6e37aa17a8c9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.175092 Oct 27 14:10:46.242424 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 248/515] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:46 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:46.247114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c0134f7f-2efd-4d4e-b030-6f4e051d8608 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:46.247745 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c0134f7f-2efd-4d4e-b030-6f4e051d8608 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:46.255311 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0134f7f-2efd-4d4e-b030-6f4e051d8608 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:46.256017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0134f7f-2efd-4d4e-b030-6f4e051d8608 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:46.256864 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0134f7f-2efd-4d4e-b030-6f4e051d8608 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:46.257363 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0134f7f-2efd-4d4e-b030-6f4e051d8608 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:46.302886 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-11b40658-e4b6-4ca7-bc4f-7ffeac8e898d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348746 Oct 27 14:10:46.303803 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 268/516] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:10:45 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:10:46.411620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c0134f7f-2efd-4d4e-b030-6f4e051d8608 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:46.419015 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c0134f7f-2efd-4d4e-b030-6f4e051d8608 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1470 microversion: 2.1 time: 0.175490 Oct 27 14:10:46.419620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 249/517] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:46 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:46.852977 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-392db646-105c-4504-a191-9e09714a71c7 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:46.853668 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-392db646-105c-4504-a191-9e09714a71c7 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:46.860438 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-392db646-105c-4504-a191-9e09714a71c7 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:46.860892 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-392db646-105c-4504-a191-9e09714a71c7 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:46.861823 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-392db646-105c-4504-a191-9e09714a71c7 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:46.862387 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-392db646-105c-4504-a191-9e09714a71c7 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:46.997364 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-392db646-105c-4504-a191-9e09714a71c7 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:47.006056 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-392db646-105c-4504-a191-9e09714a71c7 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.157135 Oct 27 14:10:47.006645 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 269/518] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:46 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:47.082342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0eda440b-26de-4f73-b122-5fcd8f43376c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:47.082872 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0eda440b-26de-4f73-b122-5fcd8f43376c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:47.088725 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0eda440b-26de-4f73-b122-5fcd8f43376c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:47.089174 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0eda440b-26de-4f73-b122-5fcd8f43376c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:47.089945 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0eda440b-26de-4f73-b122-5fcd8f43376c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:47.090406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0eda440b-26de-4f73-b122-5fcd8f43376c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:47.113753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-0eda440b-26de-4f73-b122-5fcd8f43376c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lazy-loading 'flavor' on Instance uuid 41e12ebd-fe44-4aa9-8f5e-572d91370319 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:10:47.261757 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-82f3e872-fb7f-4e29-82ef-f2a592ee60d0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:47.262477 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-82f3e872-fb7f-4e29-82ef-f2a592ee60d0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:47.269936 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-82f3e872-fb7f-4e29-82ef-f2a592ee60d0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:47.270379 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-82f3e872-fb7f-4e29-82ef-f2a592ee60d0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:47.271265 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-82f3e872-fb7f-4e29-82ef-f2a592ee60d0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:47.271663 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-82f3e872-fb7f-4e29-82ef-f2a592ee60d0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:47.423375 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-82f3e872-fb7f-4e29-82ef-f2a592ee60d0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:47.438533 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-82f3e872-fb7f-4e29-82ef-f2a592ee60d0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.180148 Oct 27 14:10:47.439112 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 270/519] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:47 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:47.444959 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b5afc4ae-921d-496a-a1b0-3d65a3a5db66 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:47.446223 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-b5afc4ae-921d-496a-a1b0-3d65a3a5db66 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:47.460126 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0eda440b-26de-4f73-b122-5fcd8f43376c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 202 len: 0 microversion: 2.20 time: 0.380993 Oct 27 14:10:47.460866 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 250/520] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:10:47 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:10:47.469419 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b5afc4ae-921d-496a-a1b0-3d65a3a5db66 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:47.470049 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b5afc4ae-921d-496a-a1b0-3d65a3a5db66 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:47.471077 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b5afc4ae-921d-496a-a1b0-3d65a3a5db66 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:47.471673 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b5afc4ae-921d-496a-a1b0-3d65a3a5db66 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:47.473598 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bd599ca8-2093-4f57-bbb4-03bb0ba17be4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:47.474388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-bd599ca8-2093-4f57-bbb4-03bb0ba17be4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:47.481071 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd599ca8-2093-4f57-bbb4-03bb0ba17be4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:47.481741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd599ca8-2093-4f57-bbb4-03bb0ba17be4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:47.483384 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd599ca8-2093-4f57-bbb4-03bb0ba17be4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:47.483834 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd599ca8-2093-4f57-bbb4-03bb0ba17be4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:47.681895 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bd599ca8-2093-4f57-bbb4-03bb0ba17be4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:47.690797 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bd599ca8-2093-4f57-bbb4-03bb0ba17be4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:47.691511 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-b5afc4ae-921d-496a-a1b0-3d65a3a5db66 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:47.692493 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bd599ca8-2093-4f57-bbb4-03bb0ba17be4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:47.693806 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bd599ca8-2093-4f57-bbb4-03bb0ba17be4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.225303 Oct 27 14:10:47.694953 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 251/521] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:47 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:10:47.700819 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b5afc4ae-921d-496a-a1b0-3d65a3a5db66 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1470 microversion: 2.1 time: 0.260268 Oct 27 14:10:47.702065 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 271/522] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:47 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:48.023686 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f4f4c3ad-30c9-44e1-9de9-47c1cfe0fd69 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:48.024319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f4f4c3ad-30c9-44e1-9de9-47c1cfe0fd69 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:48.031403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4f4c3ad-30c9-44e1-9de9-47c1cfe0fd69 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:48.031841 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4f4c3ad-30c9-44e1-9de9-47c1cfe0fd69 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:48.032642 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4f4c3ad-30c9-44e1-9de9-47c1cfe0fd69 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:48.033068 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4f4c3ad-30c9-44e1-9de9-47c1cfe0fd69 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:48.180623 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f4f4c3ad-30c9-44e1-9de9-47c1cfe0fd69 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:48.190325 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f4f4c3ad-30c9-44e1-9de9-47c1cfe0fd69 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.170201 Oct 27 14:10:48.190918 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 252/523] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:48 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:48.459272 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2cf6d60c-203d-4860-b072-199c875abcac tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:48.459888 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2cf6d60c-203d-4860-b072-199c875abcac tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:48.461901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a697ea5f-7f23-41ae-9f68-d201aeb85b66 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:48.462556 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a697ea5f-7f23-41ae-9f68-d201aeb85b66 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:48.466323 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2cf6d60c-203d-4860-b072-199c875abcac tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:48.466806 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2cf6d60c-203d-4860-b072-199c875abcac tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:48.467630 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2cf6d60c-203d-4860-b072-199c875abcac tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:48.468066 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2cf6d60c-203d-4860-b072-199c875abcac tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:48.468686 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a697ea5f-7f23-41ae-9f68-d201aeb85b66 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:48.469132 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a697ea5f-7f23-41ae-9f68-d201aeb85b66 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:48.469890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a697ea5f-7f23-41ae-9f68-d201aeb85b66 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:48.470314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a697ea5f-7f23-41ae-9f68-d201aeb85b66 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:48.599571 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-a697ea5f-7f23-41ae-9f68-d201aeb85b66 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lazy-loading 'services' on Instance uuid 16ae7a38-77b0-4cc7-966f-00e06098455d {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:10:48.608641 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2cf6d60c-203d-4860-b072-199c875abcac tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:48.616132 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2cf6d60c-203d-4860-b072-199c875abcac tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.160801 Oct 27 14:10:48.616950 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 272/524] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:48 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:48.714503 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c9cebfc1-fa9e-4c79-ad20-2438fb326e65 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:48.715407 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c9cebfc1-fa9e-4c79-ad20-2438fb326e65 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:48.725409 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c9cebfc1-fa9e-4c79-ad20-2438fb326e65 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:48.726233 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c9cebfc1-fa9e-4c79-ad20-2438fb326e65 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:48.746798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a697ea5f-7f23-41ae-9f68-d201aeb85b66 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "DELETE /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d/os-volume_attachments/9da55013-f2fd-4e9d-a683-8a43b726991c" status: 202 len: 0 microversion: 2.1 time: 0.288486 Oct 27 14:10:48.749221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 253/525] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:10:48 2021] DELETE /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d/os-volume_attachments/9da55013-f2fd-4e9d-a683-8a43b726991c => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:10:48.751889 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c9cebfc1-fa9e-4c79-ad20-2438fb326e65 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:48.752506 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c9cebfc1-fa9e-4c79-ad20-2438fb326e65 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:48.754412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a2030eda-c85e-4e16-97f4-7a6c5bdad9de tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:48.755368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a2030eda-c85e-4e16-97f4-7a6c5bdad9de tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:48.767678 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a2030eda-c85e-4e16-97f4-7a6c5bdad9de tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:48.768162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a2030eda-c85e-4e16-97f4-7a6c5bdad9de tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:48.769001 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a2030eda-c85e-4e16-97f4-7a6c5bdad9de tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:48.769431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a2030eda-c85e-4e16-97f4-7a6c5bdad9de tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:49.021691 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c9cebfc1-fa9e-4c79-ad20-2438fb326e65 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:49.028469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a2030eda-c85e-4e16-97f4-7a6c5bdad9de tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:49.031034 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c9cebfc1-fa9e-4c79-ad20-2438fb326e65 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:49.032617 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c9cebfc1-fa9e-4c79-ad20-2438fb326e65 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:49.034056 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c9cebfc1-fa9e-4c79-ad20-2438fb326e65 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.323021 Oct 27 14:10:49.034630 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 273/526] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:48 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:10:49.040817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a2030eda-c85e-4e16-97f4-7a6c5bdad9de tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1470 microversion: 2.1 time: 0.290210 Oct 27 14:10:49.050937 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 254/527] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:48 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1470 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:49.207151 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d35918b7-4714-4b12-badb-45947c910c7b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:49.207765 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d35918b7-4714-4b12-badb-45947c910c7b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:49.214462 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d35918b7-4714-4b12-badb-45947c910c7b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:49.215855 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d35918b7-4714-4b12-badb-45947c910c7b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:49.217448 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d35918b7-4714-4b12-badb-45947c910c7b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:49.218109 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d35918b7-4714-4b12-badb-45947c910c7b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:49.431048 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-d35918b7-4714-4b12-badb-45947c910c7b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:49.439672 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d35918b7-4714-4b12-badb-45947c910c7b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.236085 Oct 27 14:10:49.440255 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 274/528] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:49 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:49.581817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-fbe4006b-2eb7-41bd-af49-4ea5560aed36 req-51d12a44-edce-41ff-8b35-cb388df363ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f230df78-0ca3-435f-a01f-f0012745f170", "name": "network-vif-deleted", "tag": "1c004dab-7efc-41be-9627-415208808e90"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:49.583415 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:10:49.583415 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:10:49.591088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-fbe4006b-2eb7-41bd-af49-4ea5560aed36 req-51d12a44-edce-41ff-8b35-cb388df363ef service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:49.591488 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-fbe4006b-2eb7-41bd-af49-4ea5560aed36 req-51d12a44-edce-41ff-8b35-cb388df363ef service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:49.604919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-fbe4006b-2eb7-41bd-af49-4ea5560aed36 req-51d12a44-edce-41ff-8b35-cb388df363ef service nova] Creating event network-vif-deleted:1c004dab-7efc-41be-9627-415208808e90 for instance f230df78-0ca3-435f-a01f-f0012745f170 on hv-cinder-81566 Oct 27 14:10:49.610319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-fbe4006b-2eb7-41bd-af49-4ea5560aed36 req-51d12a44-edce-41ff-8b35-cb388df363ef service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032080 Oct 27 14:10:49.610927 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 255/529] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:10:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:49.643625 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c08c3593-10c9-4850-b328-dde90a9ac93a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:49.644250 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c08c3593-10c9-4850-b328-dde90a9ac93a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:49.657960 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c08c3593-10c9-4850-b328-dde90a9ac93a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:49.659049 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c08c3593-10c9-4850-b328-dde90a9ac93a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:49.659957 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c08c3593-10c9-4850-b328-dde90a9ac93a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:49.660396 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c08c3593-10c9-4850-b328-dde90a9ac93a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:49.830706 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c08c3593-10c9-4850-b328-dde90a9ac93a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:49.838918 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c08c3593-10c9-4850-b328-dde90a9ac93a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.199874 Oct 27 14:10:49.839538 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 275/530] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:49 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:50.053881 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-27d107f9-54d0-42f6-a2f6-3796d490d2f6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:50.054478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-27d107f9-54d0-42f6-a2f6-3796d490d2f6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:50.061359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-27d107f9-54d0-42f6-a2f6-3796d490d2f6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:50.061574 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:50.061810 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-27d107f9-54d0-42f6-a2f6-3796d490d2f6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:50.062332 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:50.062781 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-27d107f9-54d0-42f6-a2f6-3796d490d2f6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:50.063245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-27d107f9-54d0-42f6-a2f6-3796d490d2f6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:50.069233 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:50.069850 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:50.070715 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:50.071253 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:50.114712 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:50.115312 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:50.115836 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.objects.instance [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lazy-loading 'fault' on Instance uuid f230df78-0ca3-435f-a01f-f0012745f170 {{(pid=115932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:10:50.181607 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d366d8ea924851b762ebfeaf23f433', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1707281ac842ec85cb153002938ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:50.192739 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f7249451-b4c2-48b4-8661-535297ea49f3 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 200 len: 1304 microversion: 2.1 time: 0.135597 Oct 27 14:10:50.203239 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 276/531] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:50 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:50.251581 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-27d107f9-54d0-42f6-a2f6-3796d490d2f6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:50.268145 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-27d107f9-54d0-42f6-a2f6-3796d490d2f6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:50.271404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-27d107f9-54d0-42f6-a2f6-3796d490d2f6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:50.273801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-27d107f9-54d0-42f6-a2f6-3796d490d2f6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.223840 Oct 27 14:10:50.274959 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 256/532] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:50 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:10:50.457562 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-366076aa-0b57-4244-9c70-c72cb3453aaa tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:50.458194 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-366076aa-0b57-4244-9c70-c72cb3453aaa tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:50.464356 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-366076aa-0b57-4244-9c70-c72cb3453aaa tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:50.464797 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-366076aa-0b57-4244-9c70-c72cb3453aaa tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:50.465594 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-366076aa-0b57-4244-9c70-c72cb3453aaa tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:50.466020 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-366076aa-0b57-4244-9c70-c72cb3453aaa tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:50.595386 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-366076aa-0b57-4244-9c70-c72cb3453aaa tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:50.602864 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-366076aa-0b57-4244-9c70-c72cb3453aaa tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.148997 Oct 27 14:10:50.603476 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 277/533] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:50 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:50.855951 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6c66ed39-9cb3-49bd-876f-1799cfd68cd2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:50.856758 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6c66ed39-9cb3-49bd-876f-1799cfd68cd2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:50.863430 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6c66ed39-9cb3-49bd-876f-1799cfd68cd2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:50.863887 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6c66ed39-9cb3-49bd-876f-1799cfd68cd2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:50.864686 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6c66ed39-9cb3-49bd-876f-1799cfd68cd2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:50.865127 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6c66ed39-9cb3-49bd-876f-1799cfd68cd2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:51.012631 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6c66ed39-9cb3-49bd-876f-1799cfd68cd2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:51.021261 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6c66ed39-9cb3-49bd-876f-1799cfd68cd2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.168961 Oct 27 14:10:51.021862 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 257/534] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:50 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:51.210358 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e5a2ec99-0b60-4043-8e5f-a9d0e2d62716 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:51.210963 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e5a2ec99-0b60-4043-8e5f-a9d0e2d62716 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] [instance: f230df78-0ca3-435f-a01f-f0012745f170] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:51.217579 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e5a2ec99-0b60-4043-8e5f-a9d0e2d62716 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:51.218030 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e5a2ec99-0b60-4043-8e5f-a9d0e2d62716 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:51.218823 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e5a2ec99-0b60-4043-8e5f-a9d0e2d62716 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:51.219289 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e5a2ec99-0b60-4043-8e5f-a9d0e2d62716 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:51.233167 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-e5a2ec99-0b60-4043-8e5f-a9d0e2d62716 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] HTTP exception thrown: Instance f230df78-0ca3-435f-a01f-f0012745f170 could not be found. Oct 27 14:10:51.233774 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e5a2ec99-0b60-4043-8e5f-a9d0e2d62716 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] Returning 404 to user: Instance f230df78-0ca3-435f-a01f-f0012745f170 could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:10:51.234610 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e5a2ec99-0b60-4043-8e5f-a9d0e2d62716 tempest-VolumesNegativeTest-501374936 tempest-VolumesNegativeTest-501374936-project] 10.222.0.85 "GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170" status: 404 len: 111 microversion: 2.1 time: 0.027964 Oct 27 14:10:51.235228 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 278/535] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:51 2021] GET /compute/v2.1/servers/f230df78-0ca3-435f-a01f-f0012745f170 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:10:51.294062 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5350cd57-aeb6-4168-b8e1-0b3215cd8fd5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:51.294758 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5350cd57-aeb6-4168-b8e1-0b3215cd8fd5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:51.300654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5350cd57-aeb6-4168-b8e1-0b3215cd8fd5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:51.301102 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5350cd57-aeb6-4168-b8e1-0b3215cd8fd5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:51.301863 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5350cd57-aeb6-4168-b8e1-0b3215cd8fd5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:51.302306 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5350cd57-aeb6-4168-b8e1-0b3215cd8fd5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:51.450723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5350cd57-aeb6-4168-b8e1-0b3215cd8fd5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:51.459352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5350cd57-aeb6-4168-b8e1-0b3215cd8fd5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:51.460850 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5350cd57-aeb6-4168-b8e1-0b3215cd8fd5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:51.462002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5350cd57-aeb6-4168-b8e1-0b3215cd8fd5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.171933 Oct 27 14:10:51.463166 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 258/536] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:51 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:10:51.620994 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-feca34dd-1558-4ecb-bae4-63854fc1b1a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:51.621608 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-feca34dd-1558-4ecb-bae4-63854fc1b1a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:51.635757 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-feca34dd-1558-4ecb-bae4-63854fc1b1a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:51.636377 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-feca34dd-1558-4ecb-bae4-63854fc1b1a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:51.637560 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-feca34dd-1558-4ecb-bae4-63854fc1b1a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:51.638499 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-feca34dd-1558-4ecb-bae4-63854fc1b1a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:51.807359 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-feca34dd-1558-4ecb-bae4-63854fc1b1a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:51.817171 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-feca34dd-1558-4ecb-bae4-63854fc1b1a1 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.199525 Oct 27 14:10:51.817944 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 279/537] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:51 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:52.039632 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4402bb69-8f92-4170-bedb-ae02cecbde45 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:52.041099 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4402bb69-8f92-4170-bedb-ae02cecbde45 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:52.048787 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4402bb69-8f92-4170-bedb-ae02cecbde45 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:52.049312 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4402bb69-8f92-4170-bedb-ae02cecbde45 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:52.050169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4402bb69-8f92-4170-bedb-ae02cecbde45 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:52.050537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4402bb69-8f92-4170-bedb-ae02cecbde45 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:52.193406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4402bb69-8f92-4170-bedb-ae02cecbde45 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:52.200881 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4402bb69-8f92-4170-bedb-ae02cecbde45 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.165313 Oct 27 14:10:52.202165 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 259/538] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:52 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:52.498685 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a38a61c0-a152-40a8-8c3e-5544cadb7715 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:52.499892 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a38a61c0-a152-40a8-8c3e-5544cadb7715 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:52.516675 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a38a61c0-a152-40a8-8c3e-5544cadb7715 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:52.517682 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a38a61c0-a152-40a8-8c3e-5544cadb7715 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:52.518911 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a38a61c0-a152-40a8-8c3e-5544cadb7715 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:52.519741 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a38a61c0-a152-40a8-8c3e-5544cadb7715 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:52.686025 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a38a61c0-a152-40a8-8c3e-5544cadb7715 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:52.695671 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a38a61c0-a152-40a8-8c3e-5544cadb7715 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:52.697232 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a38a61c0-a152-40a8-8c3e-5544cadb7715 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:52.698415 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a38a61c0-a152-40a8-8c3e-5544cadb7715 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.220291 Oct 27 14:10:52.698934 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 280/539] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:52 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:10:52.844260 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6d42aca3-e810-43fd-81df-fe1ce8226edd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:52.844757 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6d42aca3-e810-43fd-81df-fe1ce8226edd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:52.851754 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6d42aca3-e810-43fd-81df-fe1ce8226edd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:52.852206 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6d42aca3-e810-43fd-81df-fe1ce8226edd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:52.853739 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6d42aca3-e810-43fd-81df-fe1ce8226edd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:52.854961 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6d42aca3-e810-43fd-81df-fe1ce8226edd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:53.038885 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-33cc7e88-e006-4f5e-afe3-a11da97f9f3b req-57b3a507-793b-42a1-8878-edb6636167fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17894aa2-3d8b-4ce1-bd00-92e52c1825f0", "name": "network-vif-plugged", "status": "completed", "tag": "3d0109dd-8bb8-434e-a4b1-7a4b1d7ad578"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:53.052998 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:10:53.052998 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:10:53.058305 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6d42aca3-e810-43fd-81df-fe1ce8226edd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:53.080554 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6d42aca3-e810-43fd-81df-fe1ce8226edd tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.240393 Oct 27 14:10:53.084395 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-33cc7e88-e006-4f5e-afe3-a11da97f9f3b req-57b3a507-793b-42a1-8878-edb6636167fd service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:53.095028 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 260/540] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:52 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:53.096591 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-33cc7e88-e006-4f5e-afe3-a11da97f9f3b req-57b3a507-793b-42a1-8878-edb6636167fd service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:53.110254 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-33cc7e88-e006-4f5e-afe3-a11da97f9f3b req-57b3a507-793b-42a1-8878-edb6636167fd service nova] Creating event network-vif-plugged:3d0109dd-8bb8-434e-a4b1-7a4b1d7ad578 for instance 17894aa2-3d8b-4ce1-bd00-92e52c1825f0 on hv-cinder-81566 Oct 27 14:10:53.117329 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-33cc7e88-e006-4f5e-afe3-a11da97f9f3b req-57b3a507-793b-42a1-8878-edb6636167fd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082457 Oct 27 14:10:53.118654 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 281/541] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:10:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:53.220842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8383b62f-2384-4e44-9998-de491910200c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:53.221458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8383b62f-2384-4e44-9998-de491910200c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:53.229766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8383b62f-2384-4e44-9998-de491910200c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:53.230213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8383b62f-2384-4e44-9998-de491910200c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:53.231354 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8383b62f-2384-4e44-9998-de491910200c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:53.231839 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8383b62f-2384-4e44-9998-de491910200c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:53.241999 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-159a550f-e6ab-4b9f-8332-5a3e0316da7d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:53.243431 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-159a550f-e6ab-4b9f-8332-5a3e0316da7d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:53.252778 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-159a550f-e6ab-4b9f-8332-5a3e0316da7d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:53.253242 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-159a550f-e6ab-4b9f-8332-5a3e0316da7d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:53.254817 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-159a550f-e6ab-4b9f-8332-5a3e0316da7d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:53.255730 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-159a550f-e6ab-4b9f-8332-5a3e0316da7d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:53.291059 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.objects.instance [None req-159a550f-e6ab-4b9f-8332-5a3e0316da7d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lazy-loading 'flavor' on Instance uuid adbc567f-bc87-48cd-b910-ba46c84f914d {{(pid=115932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:10:53.431936 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8383b62f-2384-4e44-9998-de491910200c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:53.442535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8383b62f-2384-4e44-9998-de491910200c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.227529 Oct 27 14:10:53.443732 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 261/542] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:53 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:53.538394 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-159a550f-e6ab-4b9f-8332-5a3e0316da7d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/action" status: 200 len: 32 microversion: 2.1 time: 0.305101 Oct 27 14:10:53.539866 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 282/543] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:10:53 2021] POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/action => generated 32 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 14:10:53.553252 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b14e05fe-f156-4d49-9077-aa5ed4aaf2fc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:53.553981 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b14e05fe-f156-4d49-9077-aa5ed4aaf2fc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:53.563327 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b14e05fe-f156-4d49-9077-aa5ed4aaf2fc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:53.563878 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b14e05fe-f156-4d49-9077-aa5ed4aaf2fc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:53.564921 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b14e05fe-f156-4d49-9077-aa5ed4aaf2fc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:53.565436 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b14e05fe-f156-4d49-9077-aa5ed4aaf2fc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:53.714368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b14e05fe-f156-4d49-9077-aa5ed4aaf2fc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:53.718051 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-500d4b3b-eb5d-40be-a707-cb480f27d053 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:53.718797 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-500d4b3b-eb5d-40be-a707-cb480f27d053 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:53.725400 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-500d4b3b-eb5d-40be-a707-cb480f27d053 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:53.725828 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b14e05fe-f156-4d49-9077-aa5ed4aaf2fc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.178009 Oct 27 14:10:53.725939 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-500d4b3b-eb5d-40be-a707-cb480f27d053 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:53.726661 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-500d4b3b-eb5d-40be-a707-cb480f27d053 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:53.727095 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-500d4b3b-eb5d-40be-a707-cb480f27d053 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:53.730110 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 262/544] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:53 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:53.868224 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-500d4b3b-eb5d-40be-a707-cb480f27d053 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:53.876589 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-500d4b3b-eb5d-40be-a707-cb480f27d053 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:53.878101 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-500d4b3b-eb5d-40be-a707-cb480f27d053 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:53.879528 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-500d4b3b-eb5d-40be-a707-cb480f27d053 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.166027 Oct 27 14:10:53.880086 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 283/545] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:53 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:10:54.123501 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ce963212-319b-4bff-ad3c-9c461be9229f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:54.123501 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ce963212-319b-4bff-ad3c-9c461be9229f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:54.135762 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ce963212-319b-4bff-ad3c-9c461be9229f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:54.136103 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ce963212-319b-4bff-ad3c-9c461be9229f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:54.137131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ce963212-319b-4bff-ad3c-9c461be9229f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:54.139839 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ce963212-319b-4bff-ad3c-9c461be9229f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:54.464528 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-fceb03aa-5a29-4b19-94b7-44287916d6ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:54.465132 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-fceb03aa-5a29-4b19-94b7-44287916d6ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:54.471937 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fceb03aa-5a29-4b19-94b7-44287916d6ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:54.472549 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fceb03aa-5a29-4b19-94b7-44287916d6ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:54.473236 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fceb03aa-5a29-4b19-94b7-44287916d6ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:54.473670 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fceb03aa-5a29-4b19-94b7-44287916d6ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:54.556494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ce963212-319b-4bff-ad3c-9c461be9229f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:54.565031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ce963212-319b-4bff-ad3c-9c461be9229f tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.466597 Oct 27 14:10:54.565987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 263/546] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:54 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:54.675931 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-fceb03aa-5a29-4b19-94b7-44287916d6ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:54.684735 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-fceb03aa-5a29-4b19-94b7-44287916d6ea tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1318 microversion: 2.1 time: 0.223738 Oct 27 14:10:54.685658 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 284/547] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:54 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:54.743269 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-03a09aeb-6232-41ed-ab6a-169d237a3c25 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:54.743895 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-03a09aeb-6232-41ed-ab6a-169d237a3c25 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:54.750865 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-03a09aeb-6232-41ed-ab6a-169d237a3c25 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:54.751420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-03a09aeb-6232-41ed-ab6a-169d237a3c25 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:54.752295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-03a09aeb-6232-41ed-ab6a-169d237a3c25 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:54.752765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-03a09aeb-6232-41ed-ab6a-169d237a3c25 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:54.886292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-03a09aeb-6232-41ed-ab6a-169d237a3c25 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:54.895291 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-03a09aeb-6232-41ed-ab6a-169d237a3c25 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.155914 Oct 27 14:10:54.896006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 264/548] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:54 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:54.899466 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1e5d622e-8df2-4d21-b5ef-a72fc5049e26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:54.899873 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1e5d622e-8df2-4d21-b5ef-a72fc5049e26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:54.910931 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e5d622e-8df2-4d21-b5ef-a72fc5049e26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:54.911406 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e5d622e-8df2-4d21-b5ef-a72fc5049e26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:54.912250 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e5d622e-8df2-4d21-b5ef-a72fc5049e26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:54.912681 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e5d622e-8df2-4d21-b5ef-a72fc5049e26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:55.043300 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1e5d622e-8df2-4d21-b5ef-a72fc5049e26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:55.051366 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1e5d622e-8df2-4d21-b5ef-a72fc5049e26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:55.052914 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1e5d622e-8df2-4d21-b5ef-a72fc5049e26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:55.054066 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1e5d622e-8df2-4d21-b5ef-a72fc5049e26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.158799 Oct 27 14:10:55.054627 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 285/549] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:54 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:10:55.150586 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-4f2f92db-de60-4b17-9c89-1cf21c13ec6f req-d3f38dea-5b91-498c-b5d8-846d80089e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac8a9f0-8970-4d42-ade8-af16e757483e", "name": "network-vif-plugged", "status": "completed", "tag": "b83fd332-cfa0-4727-9d5c-ceea41e4f808"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:55.153571 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:10:55.153571 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:10:55.162204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-4f2f92db-de60-4b17-9c89-1cf21c13ec6f req-d3f38dea-5b91-498c-b5d8-846d80089e70 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:55.162652 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-4f2f92db-de60-4b17-9c89-1cf21c13ec6f req-d3f38dea-5b91-498c-b5d8-846d80089e70 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:55.180706 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-4f2f92db-de60-4b17-9c89-1cf21c13ec6f req-d3f38dea-5b91-498c-b5d8-846d80089e70 service nova] Creating event network-vif-plugged:b83fd332-cfa0-4727-9d5c-ceea41e4f808 for instance 3ac8a9f0-8970-4d42-ade8-af16e757483e on hv-cinder-81566 Oct 27 14:10:55.194045 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-4f2f92db-de60-4b17-9c89-1cf21c13ec6f req-d3f38dea-5b91-498c-b5d8-846d80089e70 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046739 Oct 27 14:10:55.195538 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 265/550] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:10:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:10:55.582526 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c236f838-c1ad-4836-91d0-e58b77f99ecc tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:55.583156 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c236f838-c1ad-4836-91d0-e58b77f99ecc tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:55.589551 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c236f838-c1ad-4836-91d0-e58b77f99ecc tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:55.589990 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c236f838-c1ad-4836-91d0-e58b77f99ecc tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:55.590771 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c236f838-c1ad-4836-91d0-e58b77f99ecc tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:55.591271 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c236f838-c1ad-4836-91d0-e58b77f99ecc tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:55.704244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1c277e1e-fbf0-4f58-9d1f-81f5c05e9944 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:55.704857 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1c277e1e-fbf0-4f58-9d1f-81f5c05e9944 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:55.711012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c277e1e-fbf0-4f58-9d1f-81f5c05e9944 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:55.711500 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c277e1e-fbf0-4f58-9d1f-81f5c05e9944 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:55.712280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c277e1e-fbf0-4f58-9d1f-81f5c05e9944 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:55.712726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c277e1e-fbf0-4f58-9d1f-81f5c05e9944 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:55.723076 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c236f838-c1ad-4836-91d0-e58b77f99ecc tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:55.733315 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c236f838-c1ad-4836-91d0-e58b77f99ecc tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.154102 Oct 27 14:10:55.734071 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 286/551] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:55 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:55.848489 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1c277e1e-fbf0-4f58-9d1f-81f5c05e9944 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:55.855804 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1c277e1e-fbf0-4f58-9d1f-81f5c05e9944 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1509 microversion: 2.1 time: 0.156423 Oct 27 14:10:55.856375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 266/552] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:55 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:10:55.913455 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-06a2ceaf-5d7d-4006-8f6d-d86b52ccfe70 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:55.914352 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-06a2ceaf-5d7d-4006-8f6d-d86b52ccfe70 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:55.921029 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-06a2ceaf-5d7d-4006-8f6d-d86b52ccfe70 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:55.921656 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-06a2ceaf-5d7d-4006-8f6d-d86b52ccfe70 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:55.922480 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-06a2ceaf-5d7d-4006-8f6d-d86b52ccfe70 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:55.922912 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-06a2ceaf-5d7d-4006-8f6d-d86b52ccfe70 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:56.075866 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5ddae17b-0d6d-4176-9680-6b0489d7a1c7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:56.077330 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5ddae17b-0d6d-4176-9680-6b0489d7a1c7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:56.084888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5ddae17b-0d6d-4176-9680-6b0489d7a1c7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:56.085328 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5ddae17b-0d6d-4176-9680-6b0489d7a1c7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:56.086341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5ddae17b-0d6d-4176-9680-6b0489d7a1c7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:56.087046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5ddae17b-0d6d-4176-9680-6b0489d7a1c7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:56.133367 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-06a2ceaf-5d7d-4006-8f6d-d86b52ccfe70 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:56.162668 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-06a2ceaf-5d7d-4006-8f6d-d86b52ccfe70 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.252869 Oct 27 14:10:56.163288 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 287/553] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:55 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:56.293154 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5ddae17b-0d6d-4176-9680-6b0489d7a1c7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:56.302275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5ddae17b-0d6d-4176-9680-6b0489d7a1c7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:56.304140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5ddae17b-0d6d-4176-9680-6b0489d7a1c7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:56.305963 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5ddae17b-0d6d-4176-9680-6b0489d7a1c7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.234356 Oct 27 14:10:56.306712 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 267/554] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:56 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:10:56.750817 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ab47814c-4a34-4eda-aa28-102ba8285688 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:56.751503 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ab47814c-4a34-4eda-aa28-102ba8285688 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:56.758984 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ab47814c-4a34-4eda-aa28-102ba8285688 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:56.759535 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ab47814c-4a34-4eda-aa28-102ba8285688 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:56.760495 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ab47814c-4a34-4eda-aa28-102ba8285688 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:56.760997 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ab47814c-4a34-4eda-aa28-102ba8285688 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:56.911998 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ab47814c-4a34-4eda-aa28-102ba8285688 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:56.919759 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ab47814c-4a34-4eda-aa28-102ba8285688 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.173297 Oct 27 14:10:56.920416 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 288/555] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:56 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:57.179874 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d95fbee1-fcbd-4f4d-b604-a6b3f5ca70c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:57.180485 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d95fbee1-fcbd-4f4d-b604-a6b3f5ca70c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:57.187572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d95fbee1-fcbd-4f4d-b604-a6b3f5ca70c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:57.188022 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d95fbee1-fcbd-4f4d-b604-a6b3f5ca70c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:57.188799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d95fbee1-fcbd-4f4d-b604-a6b3f5ca70c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:57.189225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d95fbee1-fcbd-4f4d-b604-a6b3f5ca70c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:57.282465 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0217ac47-0613-489e-9a72-080884f06895 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9a691a3-4101-4666-9379-b4d5c682ea50"}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:10:57.284876 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0217ac47-0613-489e-9a72-080884f06895 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:57.296608 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0217ac47-0613-489e-9a72-080884f06895 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:57.297460 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0217ac47-0613-489e-9a72-080884f06895 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:57.299076 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0217ac47-0613-489e-9a72-080884f06895 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:57.300091 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0217ac47-0613-489e-9a72-080884f06895 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:57.388326 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d95fbee1-fcbd-4f4d-b604-a6b3f5ca70c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:57.404172 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d95fbee1-fcbd-4f4d-b604-a6b3f5ca70c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.225505 Oct 27 14:10:57.405834 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 268/556] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:57 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:57.411664 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-234127fb-5e16-496f-a983-0e03b03f3d6f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:57.413208 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-234127fb-5e16-496f-a983-0e03b03f3d6f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:57.427829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-234127fb-5e16-496f-a983-0e03b03f3d6f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:57.428501 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-234127fb-5e16-496f-a983-0e03b03f3d6f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:57.431056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-234127fb-5e16-496f-a983-0e03b03f3d6f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:57.431658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-234127fb-5e16-496f-a983-0e03b03f3d6f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:57.651330 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0217ac47-0613-489e-9a72-080884f06895 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "POST /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379402 Oct 27 14:10:57.651961 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 289/557] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:10:57 2021] POST /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:10:57.654949 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-234127fb-5e16-496f-a983-0e03b03f3d6f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:57.682259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-234127fb-5e16-496f-a983-0e03b03f3d6f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:57.688747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-234127fb-5e16-496f-a983-0e03b03f3d6f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:57.690606 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-234127fb-5e16-496f-a983-0e03b03f3d6f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.283633 Oct 27 14:10:57.703870 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 269/558] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:57 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:10:57.937465 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e7184043-7a88-4594-80b8-65823115cdaf tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:57.938296 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e7184043-7a88-4594-80b8-65823115cdaf tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:57.944968 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e7184043-7a88-4594-80b8-65823115cdaf tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:57.945479 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e7184043-7a88-4594-80b8-65823115cdaf tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:57.946275 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e7184043-7a88-4594-80b8-65823115cdaf tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:57.946711 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e7184043-7a88-4594-80b8-65823115cdaf tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:58.089149 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e7184043-7a88-4594-80b8-65823115cdaf tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:58.097378 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e7184043-7a88-4594-80b8-65823115cdaf tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.164978 Oct 27 14:10:58.097955 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 290/559] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:57 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:58.421822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a19b4d60-1546-4dbe-9a20-8c8f0542647e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:58.423027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a19b4d60-1546-4dbe-9a20-8c8f0542647e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:58.430753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a19b4d60-1546-4dbe-9a20-8c8f0542647e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:58.431675 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a19b4d60-1546-4dbe-9a20-8c8f0542647e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:58.433123 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a19b4d60-1546-4dbe-9a20-8c8f0542647e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:58.433808 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a19b4d60-1546-4dbe-9a20-8c8f0542647e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:58.590043 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a19b4d60-1546-4dbe-9a20-8c8f0542647e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:58.600539 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a19b4d60-1546-4dbe-9a20-8c8f0542647e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.182113 Oct 27 14:10:58.601679 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 270/560] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:58 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:58.709406 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-62cb93c1-b79e-4b56-a5a5-2bd9b65c45f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:58.709626 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-62cb93c1-b79e-4b56-a5a5-2bd9b65c45f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:58.719901 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-62cb93c1-b79e-4b56-a5a5-2bd9b65c45f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:58.720920 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-62cb93c1-b79e-4b56-a5a5-2bd9b65c45f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:58.722039 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-62cb93c1-b79e-4b56-a5a5-2bd9b65c45f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:58.722695 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-62cb93c1-b79e-4b56-a5a5-2bd9b65c45f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:58.881486 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-62cb93c1-b79e-4b56-a5a5-2bd9b65c45f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:58.891996 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-62cb93c1-b79e-4b56-a5a5-2bd9b65c45f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:58.893890 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-62cb93c1-b79e-4b56-a5a5-2bd9b65c45f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:58.895400 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-62cb93c1-b79e-4b56-a5a5-2bd9b65c45f7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.190293 Oct 27 14:10:58.896476 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 291/561] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:58 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:10:59.118384 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-802e5fbe-3eb4-40ae-8240-bf98cbd4774e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:59.118996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-802e5fbe-3eb4-40ae-8240-bf98cbd4774e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:59.125553 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-802e5fbe-3eb4-40ae-8240-bf98cbd4774e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:59.126000 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-802e5fbe-3eb4-40ae-8240-bf98cbd4774e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:59.126777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-802e5fbe-3eb4-40ae-8240-bf98cbd4774e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:59.127247 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-802e5fbe-3eb4-40ae-8240-bf98cbd4774e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:59.262855 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-802e5fbe-3eb4-40ae-8240-bf98cbd4774e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:59.270388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-802e5fbe-3eb4-40ae-8240-bf98cbd4774e tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.155872 Oct 27 14:10:59.270964 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 271/562] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:59 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:59.618782 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-57b127f3-5bec-4438-8141-41e0c12d41e0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:59.619472 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-57b127f3-5bec-4438-8141-41e0c12d41e0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:59.626781 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57b127f3-5bec-4438-8141-41e0c12d41e0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:59.627560 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57b127f3-5bec-4438-8141-41e0c12d41e0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:59.628733 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57b127f3-5bec-4438-8141-41e0c12d41e0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:59.629176 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57b127f3-5bec-4438-8141-41e0c12d41e0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:59.802354 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-57b127f3-5bec-4438-8141-41e0c12d41e0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:10:59.816048 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-57b127f3-5bec-4438-8141-41e0c12d41e0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.200971 Oct 27 14:10:59.817383 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 292/563] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:10:59 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:10:59.915579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a390757f-8ffc-4e2c-b6c5-77071afb9dd2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:10:59.916194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a390757f-8ffc-4e2c-b6c5-77071afb9dd2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:10:59.924803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a390757f-8ffc-4e2c-b6c5-77071afb9dd2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:59.925253 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a390757f-8ffc-4e2c-b6c5-77071afb9dd2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:10:59.926032 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a390757f-8ffc-4e2c-b6c5-77071afb9dd2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:10:59.926458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a390757f-8ffc-4e2c-b6c5-77071afb9dd2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:00.113840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a390757f-8ffc-4e2c-b6c5-77071afb9dd2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:00.125655 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a390757f-8ffc-4e2c-b6c5-77071afb9dd2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:00.128413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a390757f-8ffc-4e2c-b6c5-77071afb9dd2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:00.132612 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a390757f-8ffc-4e2c-b6c5-77071afb9dd2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.220720 Oct 27 14:11:00.135225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 272/564] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:10:59 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:00.288403 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-48d0243d-ab2e-4502-9cfd-8a596925b050 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:00.289998 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-48d0243d-ab2e-4502-9cfd-8a596925b050 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:00.300774 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-48d0243d-ab2e-4502-9cfd-8a596925b050 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:00.315021 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-48d0243d-ab2e-4502-9cfd-8a596925b050 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:00.315973 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-48d0243d-ab2e-4502-9cfd-8a596925b050 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:00.316426 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-48d0243d-ab2e-4502-9cfd-8a596925b050 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:00.522653 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-48d0243d-ab2e-4502-9cfd-8a596925b050 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:00.531879 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-48d0243d-ab2e-4502-9cfd-8a596925b050 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1313 microversion: 2.1 time: 0.248136 Oct 27 14:11:00.533636 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 293/565] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:00 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:00.671468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fc0b1af2-9d11-4c08-8144-c499f3caae5b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:00.678336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc0b1af2-9d11-4c08-8144-c499f3caae5b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:00.678984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc0b1af2-9d11-4c08-8144-c499f3caae5b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:00.745667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fc0b1af2-9d11-4c08-8144-c499f3caae5b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Going to try to stop instance {{(pid=115931) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 27 14:11:00.798761 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fc0b1af2-9d11-4c08-8144-c499f3caae5b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 202 len: 0 microversion: 2.1 time: 0.130746 Oct 27 14:11:00.800325 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 273/566] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:11:00 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:11:00.810259 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-be453080-f2fa-4611-a084-421570b5dea9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:00.811456 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-be453080-f2fa-4611-a084-421570b5dea9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:00.818872 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-be453080-f2fa-4611-a084-421570b5dea9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:00.819604 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-be453080-f2fa-4611-a084-421570b5dea9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:00.821488 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-be453080-f2fa-4611-a084-421570b5dea9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:00.822425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-be453080-f2fa-4611-a084-421570b5dea9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:00.836211 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-47619edb-4036-4fca-94c9-0c9504df7b04 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:00.837298 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-47619edb-4036-4fca-94c9-0c9504df7b04 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:00.846799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-47619edb-4036-4fca-94c9-0c9504df7b04 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:00.847545 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-47619edb-4036-4fca-94c9-0c9504df7b04 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:00.848720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-47619edb-4036-4fca-94c9-0c9504df7b04 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:00.849366 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-47619edb-4036-4fca-94c9-0c9504df7b04 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:01.159665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-47619edb-4036-4fca-94c9-0c9504df7b04 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:01.168159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-47619edb-4036-4fca-94c9-0c9504df7b04 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.337139 Oct 27 14:11:01.168736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 274/567] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:00 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:01.186946 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-796b1b5b-5466-400c-8037-90e9092cf0ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:01.192953 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-796b1b5b-5466-400c-8037-90e9092cf0ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:01.201399 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-796b1b5b-5466-400c-8037-90e9092cf0ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:01.201785 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-796b1b5b-5466-400c-8037-90e9092cf0ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:01.202662 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-796b1b5b-5466-400c-8037-90e9092cf0ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:01.203101 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-796b1b5b-5466-400c-8037-90e9092cf0ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:01.215177 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-be453080-f2fa-4611-a084-421570b5dea9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:01.227086 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-be453080-f2fa-4611-a084-421570b5dea9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.422280 Oct 27 14:11:01.228078 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 294/568] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:00 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:01.373543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-796b1b5b-5466-400c-8037-90e9092cf0ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:01.383825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-796b1b5b-5466-400c-8037-90e9092cf0ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:01.385342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-796b1b5b-5466-400c-8037-90e9092cf0ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:01.386560 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-796b1b5b-5466-400c-8037-90e9092cf0ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.213820 Oct 27 14:11:01.387124 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 275/569] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:01 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:01.550559 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ee65c3ce-4369-4ccd-8513-904012b9304b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:01.552229 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ee65c3ce-4369-4ccd-8513-904012b9304b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:01.558215 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ee65c3ce-4369-4ccd-8513-904012b9304b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:01.558671 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ee65c3ce-4369-4ccd-8513-904012b9304b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:01.559561 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ee65c3ce-4369-4ccd-8513-904012b9304b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:01.560181 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ee65c3ce-4369-4ccd-8513-904012b9304b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:01.765982 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ee65c3ce-4369-4ccd-8513-904012b9304b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:01.786477 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ee65c3ce-4369-4ccd-8513-904012b9304b tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1496 microversion: 2.1 time: 0.239507 Oct 27 14:11:01.794863 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cb894af0-4d9d-45ec-92c2-f88325f9fd7b tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:01.795729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cb894af0-4d9d-45ec-92c2-f88325f9fd7b tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:01.798585 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 295/570] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:01 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1496 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:01.804616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cb894af0-4d9d-45ec-92c2-f88325f9fd7b tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:01.805067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cb894af0-4d9d-45ec-92c2-f88325f9fd7b tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:01.805888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cb894af0-4d9d-45ec-92c2-f88325f9fd7b tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:01.806323 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cb894af0-4d9d-45ec-92c2-f88325f9fd7b tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:01.855592 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cb894af0-4d9d-45ec-92c2-f88325f9fd7b tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:11:01.985912 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cb894af0-4d9d-45ec-92c2-f88325f9fd7b tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "DELETE /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 204 len: 0 microversion: 2.1 time: 0.194244 Oct 27 14:11:01.992998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 276/571] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:11:01 2021] DELETE /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:11:01.998690 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-141f6158-ba21-4f0c-8872-76a996047847 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:02.000107 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-141f6158-ba21-4f0c-8872-76a996047847 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:02.008050 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-141f6158-ba21-4f0c-8872-76a996047847 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.008691 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-141f6158-ba21-4f0c-8872-76a996047847 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.009637 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-141f6158-ba21-4f0c-8872-76a996047847 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.010252 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-141f6158-ba21-4f0c-8872-76a996047847 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.185606 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-141f6158-ba21-4f0c-8872-76a996047847 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:02.190506 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7773267b-78f1-4e6c-8c33-22a4aeb2767a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:02.191214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7773267b-78f1-4e6c-8c33-22a4aeb2767a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:02.195873 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-141f6158-ba21-4f0c-8872-76a996047847 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1514 microversion: 2.1 time: 0.201282 Oct 27 14:11:02.205777 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 296/572] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:01 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:02.207939 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7773267b-78f1-4e6c-8c33-22a4aeb2767a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.208390 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7773267b-78f1-4e6c-8c33-22a4aeb2767a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.209215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7773267b-78f1-4e6c-8c33-22a4aeb2767a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.210464 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7773267b-78f1-4e6c-8c33-22a4aeb2767a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.245317 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4480e589-e529-4f18-847f-1bd05018b509 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:02.245925 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4480e589-e529-4f18-847f-1bd05018b509 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:02.252288 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4480e589-e529-4f18-847f-1bd05018b509 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.259544 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4480e589-e529-4f18-847f-1bd05018b509 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.260430 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4480e589-e529-4f18-847f-1bd05018b509 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.260828 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4480e589-e529-4f18-847f-1bd05018b509 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.565000 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4480e589-e529-4f18-847f-1bd05018b509 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:02.576865 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4480e589-e529-4f18-847f-1bd05018b509 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.333229 Oct 27 14:11:02.579013 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 297/573] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:02 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:02.584612 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-14a45dcd-972b-45ad-97b7-23a15fc917c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:02.585212 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-14a45dcd-972b-45ad-97b7-23a15fc917c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:02.595508 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7773267b-78f1-4e6c-8c33-22a4aeb2767a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:02.596311 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-14a45dcd-972b-45ad-97b7-23a15fc917c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.597099 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-14a45dcd-972b-45ad-97b7-23a15fc917c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.598060 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-14a45dcd-972b-45ad-97b7-23a15fc917c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.598651 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-14a45dcd-972b-45ad-97b7-23a15fc917c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.612197 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7773267b-78f1-4e6c-8c33-22a4aeb2767a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.429617 Oct 27 14:11:02.612873 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 277/574] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:02 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:02.626092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2d9ef97e-e2d0-4c09-bb5b-7985c558c590 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:02.626751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2d9ef97e-e2d0-4c09-bb5b-7985c558c590 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:02.642336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2d9ef97e-e2d0-4c09-bb5b-7985c558c590 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.643262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2d9ef97e-e2d0-4c09-bb5b-7985c558c590 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.645204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2d9ef97e-e2d0-4c09-bb5b-7985c558c590 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.646406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2d9ef97e-e2d0-4c09-bb5b-7985c558c590 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.711095 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2d9ef97e-e2d0-4c09-bb5b-7985c558c590 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:11:02.775361 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-14a45dcd-972b-45ad-97b7-23a15fc917c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:02.800231 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-14a45dcd-972b-45ad-97b7-23a15fc917c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:02.809502 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-14a45dcd-972b-45ad-97b7-23a15fc917c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:02.811669 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-14a45dcd-972b-45ad-97b7-23a15fc917c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.229987 Oct 27 14:11:02.812947 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 298/575] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:02 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:02.867846 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2d9ef97e-e2d0-4c09-bb5b-7985c558c590 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 204 len: 0 microversion: 2.1 time: 0.251080 Oct 27 14:11:02.868341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 278/576] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:11:02 2021] DELETE /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:11:02.877396 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2b61c11c-c06d-4794-8bf0-ad89876af09d tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:02.878316 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2b61c11c-c06d-4794-8bf0-ad89876af09d tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:02.884971 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2b61c11c-c06d-4794-8bf0-ad89876af09d tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.885647 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2b61c11c-c06d-4794-8bf0-ad89876af09d tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:02.886600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2b61c11c-c06d-4794-8bf0-ad89876af09d tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:02.887212 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2b61c11c-c06d-4794-8bf0-ad89876af09d tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:03.064387 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2b61c11c-c06d-4794-8bf0-ad89876af09d tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:03.074130 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2b61c11c-c06d-4794-8bf0-ad89876af09d tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1502 microversion: 2.1 time: 0.200401 Oct 27 14:11:03.079523 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 299/577] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:02 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:03.215507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c60cc4aa-7afb-4092-8754-e27057580555 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:03.216736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c60cc4aa-7afb-4092-8754-e27057580555 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:03.224352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c60cc4aa-7afb-4092-8754-e27057580555 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:03.224984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c60cc4aa-7afb-4092-8754-e27057580555 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:03.225921 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c60cc4aa-7afb-4092-8754-e27057580555 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:03.229455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c60cc4aa-7afb-4092-8754-e27057580555 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:03.445124 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c60cc4aa-7afb-4092-8754-e27057580555 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:03.455375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c60cc4aa-7afb-4092-8754-e27057580555 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1514 microversion: 2.1 time: 0.244917 Oct 27 14:11:03.456218 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 279/578] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:03 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:03.597182 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-fa3a4850-2823-42fd-a460-b042feda28f0 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:03.597802 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-fa3a4850-2823-42fd-a460-b042feda28f0 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:03.604086 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa3a4850-2823-42fd-a460-b042feda28f0 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:03.604535 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa3a4850-2823-42fd-a460-b042feda28f0 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:03.605649 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa3a4850-2823-42fd-a460-b042feda28f0 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:03.606194 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa3a4850-2823-42fd-a460-b042feda28f0 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:03.631351 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c08d2517-16b9-4137-8889-9095190440d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:03.632276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c08d2517-16b9-4137-8889-9095190440d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:03.642802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c08d2517-16b9-4137-8889-9095190440d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:03.644423 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c08d2517-16b9-4137-8889-9095190440d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:03.645412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c08d2517-16b9-4137-8889-9095190440d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:03.646014 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c08d2517-16b9-4137-8889-9095190440d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:03.990745 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-fa3a4850-2823-42fd-a460-b042feda28f0 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:04.001502 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-fa3a4850-2823-42fd-a460-b042feda28f0 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.407825 Oct 27 14:11:04.002625 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 300/579] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:03 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:04.010899 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-03fce51c-a389-460d-8f40-d1313e2606a0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:04.011604 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-03fce51c-a389-460d-8f40-d1313e2606a0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:04.018349 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-03fce51c-a389-460d-8f40-d1313e2606a0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:04.019046 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-03fce51c-a389-460d-8f40-d1313e2606a0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:04.019867 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-03fce51c-a389-460d-8f40-d1313e2606a0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:04.020303 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-03fce51c-a389-460d-8f40-d1313e2606a0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:04.026381 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c08d2517-16b9-4137-8889-9095190440d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:04.035897 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c08d2517-16b9-4137-8889-9095190440d2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.409545 Oct 27 14:11:04.047356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 280/580] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:03 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:04.095867 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1e3e5c8a-d5c5-4d43-8296-3925fddede93 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:04.096752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1e3e5c8a-d5c5-4d43-8296-3925fddede93 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:04.104624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1e3e5c8a-d5c5-4d43-8296-3925fddede93 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:04.105668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1e3e5c8a-d5c5-4d43-8296-3925fddede93 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:04.106698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1e3e5c8a-d5c5-4d43-8296-3925fddede93 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:04.107783 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1e3e5c8a-d5c5-4d43-8296-3925fddede93 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:04.214110 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-03fce51c-a389-460d-8f40-d1313e2606a0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:04.230761 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-03fce51c-a389-460d-8f40-d1313e2606a0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:04.234354 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-03fce51c-a389-460d-8f40-d1313e2606a0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:04.235619 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-03fce51c-a389-460d-8f40-d1313e2606a0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.231596 Oct 27 14:11:04.240129 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 301/581] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:04 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:04.372632 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1e3e5c8a-d5c5-4d43-8296-3925fddede93 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:04.381712 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1e3e5c8a-d5c5-4d43-8296-3925fddede93 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1502 microversion: 2.1 time: 0.292383 Oct 27 14:11:04.382424 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 281/582] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:04 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:04.473150 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e003764f-7c01-4e70-a6a6-98f300f6bbef tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:04.474059 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e003764f-7c01-4e70-a6a6-98f300f6bbef tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:04.479908 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e003764f-7c01-4e70-a6a6-98f300f6bbef tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:04.480355 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e003764f-7c01-4e70-a6a6-98f300f6bbef tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:04.481126 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e003764f-7c01-4e70-a6a6-98f300f6bbef tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:04.481551 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e003764f-7c01-4e70-a6a6-98f300f6bbef tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:04.934935 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e003764f-7c01-4e70-a6a6-98f300f6bbef tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:04.957188 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e003764f-7c01-4e70-a6a6-98f300f6bbef tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1514 microversion: 2.1 time: 0.487417 Oct 27 14:11:04.959190 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 302/583] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:04 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1514 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:05.019826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2567dfb6-c6be-4f96-acb9-4a4265ec5a7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:05.020433 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2567dfb6-c6be-4f96-acb9-4a4265ec5a7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:05.038902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2567dfb6-c6be-4f96-acb9-4a4265ec5a7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:05.039275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2567dfb6-c6be-4f96-acb9-4a4265ec5a7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:05.040047 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2567dfb6-c6be-4f96-acb9-4a4265ec5a7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:05.040516 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2567dfb6-c6be-4f96-acb9-4a4265ec5a7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:05.053852 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c2c6cc00-43bb-4108-80a9-11db89410629 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:05.054472 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c2c6cc00-43bb-4108-80a9-11db89410629 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:05.062894 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c2c6cc00-43bb-4108-80a9-11db89410629 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:05.065000 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c2c6cc00-43bb-4108-80a9-11db89410629 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:05.066740 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c2c6cc00-43bb-4108-80a9-11db89410629 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:05.067556 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c2c6cc00-43bb-4108-80a9-11db89410629 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:05.570847 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2567dfb6-c6be-4f96-acb9-4a4265ec5a7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:05.578014 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c2c6cc00-43bb-4108-80a9-11db89410629 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:05.580964 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2567dfb6-c6be-4f96-acb9-4a4265ec5a7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.564322 Oct 27 14:11:05.582740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 282/584] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:05 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:05.598297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5b515ef9-1296-4e41-9149-1daaef89b253 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:05.601575 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c2c6cc00-43bb-4108-80a9-11db89410629 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.551416 Oct 27 14:11:05.602563 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5b515ef9-1296-4e41-9149-1daaef89b253 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:05.605590 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 303/585] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:05 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:05.616630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b515ef9-1296-4e41-9149-1daaef89b253 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:05.616917 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e449d392-07a1-4340-9d00-61f244b391f6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:05.617597 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e449d392-07a1-4340-9d00-61f244b391f6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:05.620723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b515ef9-1296-4e41-9149-1daaef89b253 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:05.621552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b515ef9-1296-4e41-9149-1daaef89b253 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:05.621986 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b515ef9-1296-4e41-9149-1daaef89b253 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:05.643630 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e449d392-07a1-4340-9d00-61f244b391f6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:05.644083 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e449d392-07a1-4340-9d00-61f244b391f6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:05.644890 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e449d392-07a1-4340-9d00-61f244b391f6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:05.645334 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e449d392-07a1-4340-9d00-61f244b391f6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:06.306804 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e449d392-07a1-4340-9d00-61f244b391f6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:06.321447 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5b515ef9-1296-4e41-9149-1daaef89b253 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:06.326326 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e449d392-07a1-4340-9d00-61f244b391f6 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1502 microversion: 2.1 time: 0.719428 Oct 27 14:11:06.327841 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 304/586] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:05 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1502 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:06.345520 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4dba03f2-f4c2-493d-9fb1-43a491e7c71a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:06.356099 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4dba03f2-f4c2-493d-9fb1-43a491e7c71a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:06.360536 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5b515ef9-1296-4e41-9149-1daaef89b253 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:06.362190 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5b515ef9-1296-4e41-9149-1daaef89b253 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:06.363303 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4dba03f2-f4c2-493d-9fb1-43a491e7c71a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:06.363571 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5b515ef9-1296-4e41-9149-1daaef89b253 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.779233 Oct 27 14:11:06.364069 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4dba03f2-f4c2-493d-9fb1-43a491e7c71a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:06.365021 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4dba03f2-f4c2-493d-9fb1-43a491e7c71a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:06.365527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 283/587] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:05 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:06.366134 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4dba03f2-f4c2-493d-9fb1-43a491e7c71a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:06.375485 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-645280869", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1521029144", "security_groups": [{"name": "tempest-secgroup-smoke-867368291"}], "block_device_mapping_v2": [{"uuid": "fc9dc3e2-8779-469d-ba48-1fd058d07239", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9af09723-d748-420c-9b75-4c97db8a5445"}]}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:06.703228 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] validate_networks() for [('9af09723-d748-420c-9b75-4c97db8a5445', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:11:07.210396 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4dba03f2-f4c2-493d-9fb1-43a491e7c71a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:07.219803 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4dba03f2-f4c2-493d-9fb1-43a491e7c71a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 200 len: 1514 microversion: 2.1 time: 0.879666 Oct 27 14:11:07.220566 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 305/588] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:06 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 1514 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:07.235487 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e3610674-183f-4854-9a9c-f15ba748d8e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:07.236397 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e3610674-183f-4854-9a9c-f15ba748d8e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:07.245251 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e3610674-183f-4854-9a9c-f15ba748d8e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:07.246123 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e3610674-183f-4854-9a9c-f15ba748d8e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:07.247175 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e3610674-183f-4854-9a9c-f15ba748d8e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:07.247615 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e3610674-183f-4854-9a9c-f15ba748d8e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:07.668547 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e3610674-183f-4854-9a9c-f15ba748d8e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:07.677747 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e3610674-183f-4854-9a9c-f15ba748d8e4 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.447432 Oct 27 14:11:07.678584 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 306/589] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:07 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:07.684539 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e2af9c9b-e59f-472b-9f60-fbcda2cf7e5a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:07.685426 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e2af9c9b-e59f-472b-9f60-fbcda2cf7e5a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:07.692394 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e2af9c9b-e59f-472b-9f60-fbcda2cf7e5a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:07.693044 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e2af9c9b-e59f-472b-9f60-fbcda2cf7e5a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:07.693859 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e2af9c9b-e59f-472b-9f60-fbcda2cf7e5a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:07.694312 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e2af9c9b-e59f-472b-9f60-fbcda2cf7e5a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.035055 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e2af9c9b-e59f-472b-9f60-fbcda2cf7e5a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:08.047357 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e2af9c9b-e59f-472b-9f60-fbcda2cf7e5a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.367256 Oct 27 14:11:08.059202 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 307/590] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:07 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:08.067431 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-61b7e7c7-632c-4f2b-bd88-dd82614ce263 req-65ea26e7-8971-4cce-bf8d-a23b0a8b5674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ae7a38-77b0-4cc7-966f-00e06098455d", "name": "network-vif-deleted", "tag": "fd3f6935-186e-4efb-ae30-2528d5f42cf6"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:08.070198 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:08.070198 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:11:08.080913 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-61b7e7c7-632c-4f2b-bd88-dd82614ce263 req-65ea26e7-8971-4cce-bf8d-a23b0a8b5674 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.081692 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-61b7e7c7-632c-4f2b-bd88-dd82614ce263 req-65ea26e7-8971-4cce-bf8d-a23b0a8b5674 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.088318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:11:08.089343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:11:08.089999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:11:08.090564 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:11:08.091159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:11:08.101022 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.101722 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.102692 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.103351 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.107423 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-61b7e7c7-632c-4f2b-bd88-dd82614ce263 req-65ea26e7-8971-4cce-bf8d-a23b0a8b5674 service nova] Creating event network-vif-deleted:fd3f6935-186e-4efb-ae30-2528d5f42cf6 for instance 16ae7a38-77b0-4cc7-966f-00e06098455d on hv-cinder-81566 Oct 27 14:11:08.114945 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-61b7e7c7-632c-4f2b-bd88-dd82614ce263 req-65ea26e7-8971-4cce-bf8d-a23b0a8b5674 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054118 Oct 27 14:11:08.115883 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 308/591] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:08.122296 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:08.123243 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:08.125674 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Getting quotas for project 925d32172c5f44168c2eddeffc0a7da1. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:11:08.132697 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.133129 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.133920 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.134109 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Getting quotas for user aa9c479260384120a439e7f8c2dd122f and project 925d32172c5f44168c2eddeffc0a7da1. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:11:08.134359 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.172214 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.172914 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.173656 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.objects.instance [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lazy-loading 'fault' on Instance uuid 3ac8a9f0-8970-4d42-ade8-af16e757483e {{(pid=115932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:11:08.223647 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:11:08.226162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc9dc3e2-8779-469d-ba48-1fd058d07239',volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:11:08.227089 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0014f5c117f04c9295a0fcdd35a6b56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403cbdd2f7e54a148b5f8f44b38a045d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:08.239946 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a4279c71-5dfa-4e64-9d5d-135d414b9447 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 200 len: 1303 microversion: 2.1 time: 0.122494 Oct 27 14:11:08.251999 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 309/592] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:08 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:08.259280 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-9ee1a147-ba1c-468d-8f1c-061243414ebe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:08.260093 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-9ee1a147-ba1c-468d-8f1c-061243414ebe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:08.270288 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9ee1a147-ba1c-468d-8f1c-061243414ebe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.271079 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9ee1a147-ba1c-468d-8f1c-061243414ebe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.272588 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9ee1a147-ba1c-468d-8f1c-061243414ebe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.273247 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-9ee1a147-ba1c-468d-8f1c-061243414ebe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.466451 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-9ee1a147-ba1c-468d-8f1c-061243414ebe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:08.470442 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6d088200-d9bf-481d-b010-1ea05370d4d1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.103751 Oct 27 14:11:08.471817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 284/593] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:11:06 2021] POST /compute/v2.1/servers => generated 405 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:11:08.478619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-69da5de3-939d-4830-aac1-bd33a73f80c9 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:08.479569 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-69da5de3-939d-4830-aac1-bd33a73f80c9 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: 16ae7a38-77b0-4cc7-966f-00e06098455d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:08.480286 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-9ee1a147-ba1c-468d-8f1c-061243414ebe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:08.481830 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-9ee1a147-ba1c-468d-8f1c-061243414ebe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:08.483060 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-9ee1a147-ba1c-468d-8f1c-061243414ebe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.229586 Oct 27 14:11:08.502553 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 310/594] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:08 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:08.506072 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69da5de3-939d-4830-aac1-bd33a73f80c9 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.507248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69da5de3-939d-4830-aac1-bd33a73f80c9 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.508787 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69da5de3-939d-4830-aac1-bd33a73f80c9 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.509434 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69da5de3-939d-4830-aac1-bd33a73f80c9 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.512342 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-881d782e-6f2c-4fea-a1c3-79d8cfb7e298 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:08.512968 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-881d782e-6f2c-4fea-a1c3-79d8cfb7e298 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:08.532072 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-69da5de3-939d-4830-aac1-bd33a73f80c9 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] HTTP exception thrown: Instance 16ae7a38-77b0-4cc7-966f-00e06098455d could not be found. Oct 27 14:11:08.532963 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-69da5de3-939d-4830-aac1-bd33a73f80c9 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Returning 404 to user: Instance 16ae7a38-77b0-4cc7-966f-00e06098455d could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:11:08.534369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-69da5de3-939d-4830-aac1-bd33a73f80c9 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d" status: 404 len: 111 microversion: 2.1 time: 0.060534 Oct 27 14:11:08.535659 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 285/595] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:08 2021] GET /compute/v2.1/servers/16ae7a38-77b0-4cc7-966f-00e06098455d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:11:08.684405 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-881d782e-6f2c-4fea-a1c3-79d8cfb7e298 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:08.693218 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-881d782e-6f2c-4fea-a1c3-79d8cfb7e298 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1094 microversion: 2.1 time: 0.189497 Oct 27 14:11:08.695688 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 311/596] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:08 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1094 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:08.702175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2093d895-d24d-4a76-80f0-46d49b44d69b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:08.702788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2093d895-d24d-4a76-80f0-46d49b44d69b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:08.716333 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2093d895-d24d-4a76-80f0-46d49b44d69b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.721260 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2093d895-d24d-4a76-80f0-46d49b44d69b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.722113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2093d895-d24d-4a76-80f0-46d49b44d69b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.727402 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2093d895-d24d-4a76-80f0-46d49b44d69b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.919928 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-6567d8df-e4c3-49cc-bc6c-5a045b118954 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:08.921128 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-6567d8df-e4c3-49cc-bc6c-5a045b118954 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:08.928238 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6567d8df-e4c3-49cc-bc6c-5a045b118954 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.928962 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6567d8df-e4c3-49cc-bc6c-5a045b118954 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:08.929900 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6567d8df-e4c3-49cc-bc6c-5a045b118954 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:08.930629 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6567d8df-e4c3-49cc-bc6c-5a045b118954 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.018871 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2093d895-d24d-4a76-80f0-46d49b44d69b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:09.030522 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2093d895-d24d-4a76-80f0-46d49b44d69b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.337896 Oct 27 14:11:09.031645 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 286/597] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:08 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:09.065750 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-18cebdad-f0e5-4249-b54d-4f84e1d6dfeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:09.066525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-18cebdad-f0e5-4249-b54d-4f84e1d6dfeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:09.070498 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.objects.instance [None req-6567d8df-e4c3-49cc-bc6c-5a045b118954 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lazy-loading 'services' on Instance uuid 17894aa2-3d8b-4ce1-bd00-92e52c1825f0 {{(pid=115932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:11:09.077632 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18cebdad-f0e5-4249-b54d-4f84e1d6dfeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:09.078083 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18cebdad-f0e5-4249-b54d-4f84e1d6dfeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.078874 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18cebdad-f0e5-4249-b54d-4f84e1d6dfeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:09.087004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18cebdad-f0e5-4249-b54d-4f84e1d6dfeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.190568 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-6567d8df-e4c3-49cc-bc6c-5a045b118954 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments/b9a691a3-4101-4666-9379-b4d5c682ea50" status: 202 len: 0 microversion: 2.1 time: 0.277648 Oct 27 14:11:09.192598 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 312/598] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:11:08 2021] DELETE /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments/b9a691a3-4101-4666-9379-b4d5c682ea50 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:11:09.205505 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2a145ca3-0986-4d3a-9b86-d862815fa3c5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:09.207026 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2a145ca3-0986-4d3a-9b86-d862815fa3c5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:09.220874 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2a145ca3-0986-4d3a-9b86-d862815fa3c5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:09.221733 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2a145ca3-0986-4d3a-9b86-d862815fa3c5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.222978 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2a145ca3-0986-4d3a-9b86-d862815fa3c5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:09.224107 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2a145ca3-0986-4d3a-9b86-d862815fa3c5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.268512 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2a145ca3-0986-4d3a-9b86-d862815fa3c5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070420 Oct 27 14:11:09.273257 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 313/599] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:11:09 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:09.279254 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a357a4f3-2bfe-4de9-bcf5-666a67087c09 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:09.280188 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a357a4f3-2bfe-4de9-bcf5-666a67087c09 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] [instance: 3ac8a9f0-8970-4d42-ade8-af16e757483e] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:09.286346 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a357a4f3-2bfe-4de9-bcf5-666a67087c09 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:09.287054 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a357a4f3-2bfe-4de9-bcf5-666a67087c09 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.288051 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a357a4f3-2bfe-4de9-bcf5-666a67087c09 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:09.288643 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a357a4f3-2bfe-4de9-bcf5-666a67087c09 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.303649 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-a357a4f3-2bfe-4de9-bcf5-666a67087c09 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] HTTP exception thrown: Instance 3ac8a9f0-8970-4d42-ade8-af16e757483e could not be found. Oct 27 14:11:09.304698 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a357a4f3-2bfe-4de9-bcf5-666a67087c09 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] Returning 404 to user: Instance 3ac8a9f0-8970-4d42-ade8-af16e757483e could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:11:09.305548 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a357a4f3-2bfe-4de9-bcf5-666a67087c09 tempest-VolumesActionsTest-788342814 tempest-VolumesActionsTest-788342814-project] 10.222.0.85 "GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e" status: 404 len: 111 microversion: 2.1 time: 0.031104 Oct 27 14:11:09.306426 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 314/600] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:09 2021] GET /compute/v2.1/servers/3ac8a9f0-8970-4d42-ade8-af16e757483e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:11:09.333387 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-18cebdad-f0e5-4249-b54d-4f84e1d6dfeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:09.345114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-18cebdad-f0e5-4249-b54d-4f84e1d6dfeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.284282 Oct 27 14:11:09.346737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 287/601] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:09 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:09.511982 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c425c89d-fe5d-482a-91dc-29e7370ee3c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:09.513244 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c425c89d-fe5d-482a-91dc-29e7370ee3c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:09.525764 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c425c89d-fe5d-482a-91dc-29e7370ee3c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:09.526791 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c425c89d-fe5d-482a-91dc-29e7370ee3c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.528191 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c425c89d-fe5d-482a-91dc-29e7370ee3c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:09.528638 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c425c89d-fe5d-482a-91dc-29e7370ee3c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.710870 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d762dea1-08c5-40ef-93e9-21a69c332f12 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:09.711532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d762dea1-08c5-40ef-93e9-21a69c332f12 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:09.713259 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c425c89d-fe5d-482a-91dc-29e7370ee3c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:09.718572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d762dea1-08c5-40ef-93e9-21a69c332f12 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:09.718968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d762dea1-08c5-40ef-93e9-21a69c332f12 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.719795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d762dea1-08c5-40ef-93e9-21a69c332f12 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:09.720388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d762dea1-08c5-40ef-93e9-21a69c332f12 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:09.729405 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c425c89d-fe5d-482a-91dc-29e7370ee3c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:09.735340 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c425c89d-fe5d-482a-91dc-29e7370ee3c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:09.738701 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c425c89d-fe5d-482a-91dc-29e7370ee3c4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.232043 Oct 27 14:11:09.752063 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 315/602] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:09 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:09.833910 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d762dea1-08c5-40ef-93e9-21a69c332f12 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:09.844055 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d762dea1-08c5-40ef-93e9-21a69c332f12 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1144 microversion: 2.1 time: 0.137996 Oct 27 14:11:09.844766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 288/603] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:09 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1144 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:10.068890 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-c457e321-57ab-4c35-923f-f1fbf82a67ef tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:10.068890 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-c457e321-57ab-4c35-923f-f1fbf82a67ef tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:10.091395 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c457e321-57ab-4c35-923f-f1fbf82a67ef tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.091864 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c457e321-57ab-4c35-923f-f1fbf82a67ef tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.092697 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c457e321-57ab-4c35-923f-f1fbf82a67ef tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.094318 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-c457e321-57ab-4c35-923f-f1fbf82a67ef tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.137245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-bfb01369-c132-4e97-9cbc-0455f971aaf2 req-32a8a604-6403-43a8-8d20-b44d89f50e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ac8a9f0-8970-4d42-ade8-af16e757483e", "name": "network-vif-deleted", "tag": "b83fd332-cfa0-4727-9d5c-ceea41e4f808"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:10.141158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:10.141158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:11:10.153517 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-bfb01369-c132-4e97-9cbc-0455f971aaf2 req-32a8a604-6403-43a8-8d20-b44d89f50e42 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.154235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-bfb01369-c132-4e97-9cbc-0455f971aaf2 req-32a8a604-6403-43a8-8d20-b44d89f50e42 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.198316 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-bfb01369-c132-4e97-9cbc-0455f971aaf2 req-32a8a604-6403-43a8-8d20-b44d89f50e42 service nova] Creating event network-vif-deleted:b83fd332-cfa0-4727-9d5c-ceea41e4f808 for instance 3ac8a9f0-8970-4d42-ade8-af16e757483e on hv-cinder-81566 Oct 27 14:11:10.204700 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-bfb01369-c132-4e97-9cbc-0455f971aaf2 req-32a8a604-6403-43a8-8d20-b44d89f50e42 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074091 Oct 27 14:11:10.205901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 289/604] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:11:10.281458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d12db60e-6a77-4f98-8d25-3e2bf99243bd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:10.282798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d12db60e-6a77-4f98-8d25-3e2bf99243bd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:10.295207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d12db60e-6a77-4f98-8d25-3e2bf99243bd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.302344 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d12db60e-6a77-4f98-8d25-3e2bf99243bd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.303505 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d12db60e-6a77-4f98-8d25-3e2bf99243bd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.305364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d12db60e-6a77-4f98-8d25-3e2bf99243bd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.361348 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-c457e321-57ab-4c35-923f-f1fbf82a67ef tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:10.365864 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d12db60e-6a77-4f98-8d25-3e2bf99243bd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089508 Oct 27 14:11:10.367368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 290/605] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:11:10 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:11:10.375076 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7e0136ae-cd92-4dce-b41c-8462876f7eae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:10.376012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7e0136ae-cd92-4dce-b41c-8462876f7eae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:10.377841 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-c457e321-57ab-4c35-923f-f1fbf82a67ef tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.332115 Oct 27 14:11:10.379186 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 316/606] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:10 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:10.386149 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e0136ae-cd92-4dce-b41c-8462876f7eae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.386692 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e0136ae-cd92-4dce-b41c-8462876f7eae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.387689 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e0136ae-cd92-4dce-b41c-8462876f7eae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.388359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e0136ae-cd92-4dce-b41c-8462876f7eae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.582904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7e0136ae-cd92-4dce-b41c-8462876f7eae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:10.592229 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7e0136ae-cd92-4dce-b41c-8462876f7eae tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.223491 Oct 27 14:11:10.599993 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 291/607] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:10 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:10.758395 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7b744cd0-3e80-49e9-8a26-24efb43dadb9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:10.759080 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7b744cd0-3e80-49e9-8a26-24efb43dadb9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:10.769204 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7b744cd0-3e80-49e9-8a26-24efb43dadb9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.770360 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7b744cd0-3e80-49e9-8a26-24efb43dadb9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.771552 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7b744cd0-3e80-49e9-8a26-24efb43dadb9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.772269 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7b744cd0-3e80-49e9-8a26-24efb43dadb9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.864778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4e575e27-df1a-450e-b7a4-f6fe9caa6597 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:10.865736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4e575e27-df1a-450e-b7a4-f6fe9caa6597 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:10.872754 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4e575e27-df1a-450e-b7a4-f6fe9caa6597 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.873250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4e575e27-df1a-450e-b7a4-f6fe9caa6597 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.874610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4e575e27-df1a-450e-b7a4-f6fe9caa6597 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:10.875067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4e575e27-df1a-450e-b7a4-f6fe9caa6597 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:10.936306 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-7b744cd0-3e80-49e9-8a26-24efb43dadb9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:10.945979 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-7b744cd0-3e80-49e9-8a26-24efb43dadb9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:10.947720 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-7b744cd0-3e80-49e9-8a26-24efb43dadb9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:10.954829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4e575e27-df1a-450e-b7a4-f6fe9caa6597 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:10.961234 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7b744cd0-3e80-49e9-8a26-24efb43dadb9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.198594 Oct 27 14:11:10.962101 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 317/608] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:10 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:10.963664 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4e575e27-df1a-450e-b7a4-f6fe9caa6597 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1136 microversion: 2.1 time: 0.106433 Oct 27 14:11:10.973879 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 292/609] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:10 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1136 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:11.379938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-73ba892a-415c-4061-929f-fd444b5c70a2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:11.380868 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-73ba892a-415c-4061-929f-fd444b5c70a2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:11.388052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-73ba892a-415c-4061-929f-fd444b5c70a2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:11.388510 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-73ba892a-415c-4061-929f-fd444b5c70a2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:11.389786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-73ba892a-415c-4061-929f-fd444b5c70a2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:11.390213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-73ba892a-415c-4061-929f-fd444b5c70a2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:11.396726 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a886c85d-87c4-4cf1-bcb0-127b29a2a2e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:11.397438 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a886c85d-87c4-4cf1-bcb0-127b29a2a2e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:11.409885 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a886c85d-87c4-4cf1-bcb0-127b29a2a2e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:11.410665 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a886c85d-87c4-4cf1-bcb0-127b29a2a2e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:11.411660 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a886c85d-87c4-4cf1-bcb0-127b29a2a2e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:11.412425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a886c85d-87c4-4cf1-bcb0-127b29a2a2e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:11.430863 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-73ba892a-415c-4061-929f-fd444b5c70a2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056602 Oct 27 14:11:11.433978 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 293/610] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:11:11 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:11.618096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-285ab27d-ec6f-4980-9762-e1930fe7168f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:11.619028 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-285ab27d-ec6f-4980-9762-e1930fe7168f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:11.628325 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a886c85d-87c4-4cf1-bcb0-127b29a2a2e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:11.641075 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-285ab27d-ec6f-4980-9762-e1930fe7168f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:11.642589 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-285ab27d-ec6f-4980-9762-e1930fe7168f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:11.644843 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a886c85d-87c4-4cf1-bcb0-127b29a2a2e8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.249931 Oct 27 14:11:11.646215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-285ab27d-ec6f-4980-9762-e1930fe7168f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:11.646821 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 318/611] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:11 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:11.647444 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-285ab27d-ec6f-4980-9762-e1930fe7168f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:11.833386 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-285ab27d-ec6f-4980-9762-e1930fe7168f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:11.841713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-285ab27d-ec6f-4980-9762-e1930fe7168f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.228180 Oct 27 14:11:11.843898 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 294/612] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:11 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:11.987691 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8262b8a9-75fc-47bb-b505-14dd9b26e72c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:11.990882 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8262b8a9-75fc-47bb-b505-14dd9b26e72c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:11.991411 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4d82e49c-aa36-45e8-b3de-f9943bb097c0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:11.992397 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4d82e49c-aa36-45e8-b3de-f9943bb097c0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:12.008187 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4d82e49c-aa36-45e8-b3de-f9943bb097c0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:12.008696 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8262b8a9-75fc-47bb-b505-14dd9b26e72c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:12.009165 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4d82e49c-aa36-45e8-b3de-f9943bb097c0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:12.010208 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8262b8a9-75fc-47bb-b505-14dd9b26e72c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:12.010910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4d82e49c-aa36-45e8-b3de-f9943bb097c0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:12.011023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8262b8a9-75fc-47bb-b505-14dd9b26e72c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:12.011619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8262b8a9-75fc-47bb-b505-14dd9b26e72c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:12.012090 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4d82e49c-aa36-45e8-b3de-f9943bb097c0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:12.135021 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8262b8a9-75fc-47bb-b505-14dd9b26e72c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:12.144058 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8262b8a9-75fc-47bb-b505-14dd9b26e72c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1192 microversion: 2.1 time: 0.165309 Oct 27 14:11:12.144627 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 295/613] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:11 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1192 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:12.276233 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4d82e49c-aa36-45e8-b3de-f9943bb097c0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:12.285140 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4d82e49c-aa36-45e8-b3de-f9943bb097c0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:12.290879 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4d82e49c-aa36-45e8-b3de-f9943bb097c0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:12.292574 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4d82e49c-aa36-45e8-b3de-f9943bb097c0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.314897 Oct 27 14:11:12.293142 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 319/614] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:11 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:12.445079 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d88b1c8f-47dd-44f1-873a-1a45c8cb33db tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:12.446936 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d88b1c8f-47dd-44f1-873a-1a45c8cb33db tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:12.454311 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d88b1c8f-47dd-44f1-873a-1a45c8cb33db tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:12.455101 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d88b1c8f-47dd-44f1-873a-1a45c8cb33db tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:12.456757 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d88b1c8f-47dd-44f1-873a-1a45c8cb33db tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:12.458088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d88b1c8f-47dd-44f1-873a-1a45c8cb33db tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:12.489767 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d88b1c8f-47dd-44f1-873a-1a45c8cb33db tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048475 Oct 27 14:11:12.497831 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 296/615] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:11:12 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:12.666170 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-158bef95-7cb8-4d95-bdd5-f14c4d8f2ae1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:12.667515 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-158bef95-7cb8-4d95-bdd5-f14c4d8f2ae1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:12.677513 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-158bef95-7cb8-4d95-bdd5-f14c4d8f2ae1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:12.677950 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-158bef95-7cb8-4d95-bdd5-f14c4d8f2ae1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:12.678721 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-158bef95-7cb8-4d95-bdd5-f14c4d8f2ae1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:12.679160 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-158bef95-7cb8-4d95-bdd5-f14c4d8f2ae1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:12.822449 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-158bef95-7cb8-4d95-bdd5-f14c4d8f2ae1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:12.831107 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-158bef95-7cb8-4d95-bdd5-f14c4d8f2ae1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.168796 Oct 27 14:11:12.833058 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 320/616] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:12 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:12.859676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3987aad3-d253-4da5-b489-a317365cd251 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:12.860383 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3987aad3-d253-4da5-b489-a317365cd251 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:12.871079 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3987aad3-d253-4da5-b489-a317365cd251 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:12.871887 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3987aad3-d253-4da5-b489-a317365cd251 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:12.872735 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3987aad3-d253-4da5-b489-a317365cd251 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:12.873416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3987aad3-d253-4da5-b489-a317365cd251 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:13.024844 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3987aad3-d253-4da5-b489-a317365cd251 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:13.033482 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3987aad3-d253-4da5-b489-a317365cd251 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.177540 Oct 27 14:11:13.034052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 297/617] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:12 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:13.161681 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-5f510c0e-e0a1-40bf-acc6-8c2146d7c0a8 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:13.162638 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-5f510c0e-e0a1-40bf-acc6-8c2146d7c0a8 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:13.168791 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5f510c0e-e0a1-40bf-acc6-8c2146d7c0a8 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:13.169473 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5f510c0e-e0a1-40bf-acc6-8c2146d7c0a8 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:13.171160 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5f510c0e-e0a1-40bf-acc6-8c2146d7c0a8 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:13.171880 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-5f510c0e-e0a1-40bf-acc6-8c2146d7c0a8 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:13.241435 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-5f510c0e-e0a1-40bf-acc6-8c2146d7c0a8 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:13.250764 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-5f510c0e-e0a1-40bf-acc6-8c2146d7c0a8 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1192 microversion: 2.1 time: 0.092521 Oct 27 14:11:13.251696 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 321/618] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:13 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:13.312334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-da23ae73-5793-4973-ae40-64d56c505860 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:13.313362 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-da23ae73-5793-4973-ae40-64d56c505860 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:13.322286 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da23ae73-5793-4973-ae40-64d56c505860 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:13.322843 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da23ae73-5793-4973-ae40-64d56c505860 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:13.323904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da23ae73-5793-4973-ae40-64d56c505860 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:13.324584 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da23ae73-5793-4973-ae40-64d56c505860 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:13.476581 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-da23ae73-5793-4973-ae40-64d56c505860 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:13.485735 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-da23ae73-5793-4973-ae40-64d56c505860 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:13.487262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-da23ae73-5793-4973-ae40-64d56c505860 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:13.488610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-da23ae73-5793-4973-ae40-64d56c505860 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.180312 Oct 27 14:11:13.489671 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 298/619] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:13 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:13.508111 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f1e0b0fb-50ff-43ee-87e1-967a2a9d9da0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:13.509488 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f1e0b0fb-50ff-43ee-87e1-967a2a9d9da0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:13.517974 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f1e0b0fb-50ff-43ee-87e1-967a2a9d9da0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:13.520104 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f1e0b0fb-50ff-43ee-87e1-967a2a9d9da0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:13.521342 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f1e0b0fb-50ff-43ee-87e1-967a2a9d9da0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:13.522365 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f1e0b0fb-50ff-43ee-87e1-967a2a9d9da0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:13.571829 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f1e0b0fb-50ff-43ee-87e1-967a2a9d9da0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065446 Oct 27 14:11:13.572441 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 322/620] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:11:13 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:13.848959 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c1747937-d114-40fc-a087-957eec53a4af tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:13.851768 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c1747937-d114-40fc-a087-957eec53a4af tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:13.859642 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1747937-d114-40fc-a087-957eec53a4af tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:13.860433 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1747937-d114-40fc-a087-957eec53a4af tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:13.861458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1747937-d114-40fc-a087-957eec53a4af tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:13.862107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1747937-d114-40fc-a087-957eec53a4af tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:14.022279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c1747937-d114-40fc-a087-957eec53a4af tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:14.035454 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c1747937-d114-40fc-a087-957eec53a4af tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.190054 Oct 27 14:11:14.036671 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 299/621] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:13 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:14.050318 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1d007a87-d469-4c76-ab90-de95a7f07674 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:14.051218 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1d007a87-d469-4c76-ab90-de95a7f07674 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:14.060130 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1d007a87-d469-4c76-ab90-de95a7f07674 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:14.060568 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1d007a87-d469-4c76-ab90-de95a7f07674 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:14.064254 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1d007a87-d469-4c76-ab90-de95a7f07674 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:14.064736 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1d007a87-d469-4c76-ab90-de95a7f07674 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:14.269478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-57824847-0146-41d1-b24c-63070181b438 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:14.270241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-57824847-0146-41d1-b24c-63070181b438 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:14.287333 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57824847-0146-41d1-b24c-63070181b438 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:14.288177 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57824847-0146-41d1-b24c-63070181b438 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:14.289195 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57824847-0146-41d1-b24c-63070181b438 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:14.290068 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57824847-0146-41d1-b24c-63070181b438 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:14.309030 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1d007a87-d469-4c76-ab90-de95a7f07674 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:14.321252 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1d007a87-d469-4c76-ab90-de95a7f07674 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.274595 Oct 27 14:11:14.321835 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 323/622] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:14 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:14.385819 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-57824847-0146-41d1-b24c-63070181b438 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:14.395204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-57824847-0146-41d1-b24c-63070181b438 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1192 microversion: 2.1 time: 0.131848 Oct 27 14:11:14.407046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 300/623] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:14 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1192 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:14.509831 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b31998ff-27c4-410e-ae18-c4ed89cf174a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:14.510440 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-b31998ff-27c4-410e-ae18-c4ed89cf174a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:14.541154 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b31998ff-27c4-410e-ae18-c4ed89cf174a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:14.543221 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b31998ff-27c4-410e-ae18-c4ed89cf174a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:14.544355 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b31998ff-27c4-410e-ae18-c4ed89cf174a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:14.546136 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b31998ff-27c4-410e-ae18-c4ed89cf174a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:14.585639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5506abbb-f225-41fc-824c-351c31660ab6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:14.586720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5506abbb-f225-41fc-824c-351c31660ab6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:14.613269 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5506abbb-f225-41fc-824c-351c31660ab6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:14.620904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5506abbb-f225-41fc-824c-351c31660ab6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:14.622140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5506abbb-f225-41fc-824c-351c31660ab6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:14.622793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5506abbb-f225-41fc-824c-351c31660ab6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:14.801010 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5506abbb-f225-41fc-824c-351c31660ab6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220960 Oct 27 14:11:14.802663 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 301/624] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:11:14 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:14.913892 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-b31998ff-27c4-410e-ae18-c4ed89cf174a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:14.948670 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-b31998ff-27c4-410e-ae18-c4ed89cf174a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:14.952100 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-b31998ff-27c4-410e-ae18-c4ed89cf174a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:14.953960 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b31998ff-27c4-410e-ae18-c4ed89cf174a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.448486 Oct 27 14:11:14.969247 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 324/625] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:14 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:15.066927 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-66b94944-04e4-4993-b6c5-5094bd5f824f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:15.070953 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-66b94944-04e4-4993-b6c5-5094bd5f824f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:15.085421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66b94944-04e4-4993-b6c5-5094bd5f824f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:15.085981 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66b94944-04e4-4993-b6c5-5094bd5f824f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:15.086898 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66b94944-04e4-4993-b6c5-5094bd5f824f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:15.087694 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66b94944-04e4-4993-b6c5-5094bd5f824f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:15.340188 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0f09ab5a-eb9b-41b8-9b8f-6f60ec4aaf74 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:15.341475 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0f09ab5a-eb9b-41b8-9b8f-6f60ec4aaf74 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:15.348946 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0f09ab5a-eb9b-41b8-9b8f-6f60ec4aaf74 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:15.360897 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0f09ab5a-eb9b-41b8-9b8f-6f60ec4aaf74 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:15.362046 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0f09ab5a-eb9b-41b8-9b8f-6f60ec4aaf74 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:15.362674 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0f09ab5a-eb9b-41b8-9b8f-6f60ec4aaf74 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:16.146586 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-66b94944-04e4-4993-b6c5-5094bd5f824f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:16.157064 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-66b94944-04e4-4993-b6c5-5094bd5f824f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 1.106244 Oct 27 14:11:16.163242 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 302/626] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:15 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:16.172444 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-33982cd2-aaf4-491e-9b20-3e207ad9c448 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:16.173339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-33982cd2-aaf4-491e-9b20-3e207ad9c448 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:16.182177 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-33982cd2-aaf4-491e-9b20-3e207ad9c448 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:16.186517 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-33982cd2-aaf4-491e-9b20-3e207ad9c448 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:16.189921 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-33982cd2-aaf4-491e-9b20-3e207ad9c448 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:16.191856 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-33982cd2-aaf4-491e-9b20-3e207ad9c448 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:16.196538 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-0f09ab5a-eb9b-41b8-9b8f-6f60ec4aaf74 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:16.205488 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0f09ab5a-eb9b-41b8-9b8f-6f60ec4aaf74 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.869085 Oct 27 14:11:16.226205 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 325/627] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:15 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:16.242637 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-cddf476d-8629-4c2b-b89d-fbc1ecc41b72 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:16.245379 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-cddf476d-8629-4c2b-b89d-fbc1ecc41b72 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:16.266002 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-cddf476d-8629-4c2b-b89d-fbc1ecc41b72 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:16.267622 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-cddf476d-8629-4c2b-b89d-fbc1ecc41b72 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:16.270426 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-cddf476d-8629-4c2b-b89d-fbc1ecc41b72 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:16.271896 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-cddf476d-8629-4c2b-b89d-fbc1ecc41b72 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:16.380573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-33982cd2-aaf4-491e-9b20-3e207ad9c448 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:16.388658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-33982cd2-aaf4-491e-9b20-3e207ad9c448 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1210 microversion: 2.1 time: 0.223672 Oct 27 14:11:16.398766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 303/628] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:16 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1210 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:16.406463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b3d4822c-e826-4403-9af7-1a4f8764220f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:16.407468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b3d4822c-e826-4403-9af7-1a4f8764220f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:16.415702 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-cddf476d-8629-4c2b-b89d-fbc1ecc41b72 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.188042 Oct 27 14:11:16.416754 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 326/629] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:11:16 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0/os-volume_attachments => generated 25 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:11:16.427161 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3d4822c-e826-4403-9af7-1a4f8764220f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:16.427441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3d4822c-e826-4403-9af7-1a4f8764220f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:16.428285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3d4822c-e826-4403-9af7-1a4f8764220f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:16.428523 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3d4822c-e826-4403-9af7-1a4f8764220f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:16.717119 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b3d4822c-e826-4403-9af7-1a4f8764220f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:16.725926 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b3d4822c-e826-4403-9af7-1a4f8764220f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:16.727769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b3d4822c-e826-4403-9af7-1a4f8764220f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:16.729140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b3d4822c-e826-4403-9af7-1a4f8764220f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.330412 Oct 27 14:11:16.730197 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 304/630] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:16 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:17.181642 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1a3aacfd-e564-4725-ad6a-2d64f2841839 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:17.182482 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1a3aacfd-e564-4725-ad6a-2d64f2841839 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:17.210844 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1a3aacfd-e564-4725-ad6a-2d64f2841839 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:17.211832 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1a3aacfd-e564-4725-ad6a-2d64f2841839 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:17.213120 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1a3aacfd-e564-4725-ad6a-2d64f2841839 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:17.213710 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1a3aacfd-e564-4725-ad6a-2d64f2841839 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:17.232765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-09803c78-cc18-4702-a65f-9fb41b31c64d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:17.243900 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-09803c78-cc18-4702-a65f-9fb41b31c64d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:17.253904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-09803c78-cc18-4702-a65f-9fb41b31c64d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:17.254822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-09803c78-cc18-4702-a65f-9fb41b31c64d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:17.255931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-09803c78-cc18-4702-a65f-9fb41b31c64d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:17.258823 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-09803c78-cc18-4702-a65f-9fb41b31c64d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:17.602563 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1a3aacfd-e564-4725-ad6a-2d64f2841839 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:17.613174 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-09803c78-cc18-4702-a65f-9fb41b31c64d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:17.617224 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1a3aacfd-e564-4725-ad6a-2d64f2841839 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.439047 Oct 27 14:11:17.621462 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 327/631] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:17 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:17.626762 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ca57dfc7-abd8-48e2-abde-aa46e1961d84 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:17.632541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-09803c78-cc18-4702-a65f-9fb41b31c64d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.401833 Oct 27 14:11:17.636247 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ca57dfc7-abd8-48e2-abde-aa46e1961d84 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:17.637438 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 305/632] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:17 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:17.653731 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ca57dfc7-abd8-48e2-abde-aa46e1961d84 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:17.653731 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ca57dfc7-abd8-48e2-abde-aa46e1961d84 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:17.654599 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ca57dfc7-abd8-48e2-abde-aa46e1961d84 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:17.655276 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ca57dfc7-abd8-48e2-abde-aa46e1961d84 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:17.751292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-624e29b7-a1de-4ab8-a0b2-8a3a77e1e0f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:17.752263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-624e29b7-a1de-4ab8-a0b2-8a3a77e1e0f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:17.760833 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-624e29b7-a1de-4ab8-a0b2-8a3a77e1e0f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:17.761603 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-624e29b7-a1de-4ab8-a0b2-8a3a77e1e0f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:17.762699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-624e29b7-a1de-4ab8-a0b2-8a3a77e1e0f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:17.763421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-624e29b7-a1de-4ab8-a0b2-8a3a77e1e0f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:17.957350 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ca57dfc7-abd8-48e2-abde-aa46e1961d84 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:17.965256 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ca57dfc7-abd8-48e2-abde-aa46e1961d84 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1277 microversion: 2.1 time: 0.342503 Oct 27 14:11:17.967644 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 328/633] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:17 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1277 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:18.173214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-624e29b7-a1de-4ab8-a0b2-8a3a77e1e0f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:18.187756 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-624e29b7-a1de-4ab8-a0b2-8a3a77e1e0f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:18.190061 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-624e29b7-a1de-4ab8-a0b2-8a3a77e1e0f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:18.192372 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-624e29b7-a1de-4ab8-a0b2-8a3a77e1e0f3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.446667 Oct 27 14:11:18.193482 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 306/634] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:17 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:18.641313 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-911ce77a-b90a-4008-bbc5-34af3e61df33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:18.642006 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-911ce77a-b90a-4008-bbc5-34af3e61df33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:18.650532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c5cd896a-8f16-4447-a0e0-af88b3302a34 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:18.651306 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c5cd896a-8f16-4447-a0e0-af88b3302a34 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:18.673312 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-911ce77a-b90a-4008-bbc5-34af3e61df33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:18.673762 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-911ce77a-b90a-4008-bbc5-34af3e61df33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:18.674549 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-911ce77a-b90a-4008-bbc5-34af3e61df33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:18.674973 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-911ce77a-b90a-4008-bbc5-34af3e61df33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:18.682344 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c5cd896a-8f16-4447-a0e0-af88b3302a34 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:18.682797 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c5cd896a-8f16-4447-a0e0-af88b3302a34 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:18.684204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c5cd896a-8f16-4447-a0e0-af88b3302a34 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:18.684633 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c5cd896a-8f16-4447-a0e0-af88b3302a34 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:19.148124 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c5cd896a-8f16-4447-a0e0-af88b3302a34 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:19.167421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c5cd896a-8f16-4447-a0e0-af88b3302a34 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.520500 Oct 27 14:11:19.168299 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 307/635] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:18 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:19.186023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4ac8c34f-6167-45c7-8bca-52442a2771f2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:19.192799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4ac8c34f-6167-45c7-8bca-52442a2771f2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:19.207059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4ac8c34f-6167-45c7-8bca-52442a2771f2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:19.209483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4ac8c34f-6167-45c7-8bca-52442a2771f2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:19.212322 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4ac8c34f-6167-45c7-8bca-52442a2771f2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:19.214121 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4ac8c34f-6167-45c7-8bca-52442a2771f2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:19.430048 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-911ce77a-b90a-4008-bbc5-34af3e61df33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:19.444268 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-911ce77a-b90a-4008-bbc5-34af3e61df33 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.808276 Oct 27 14:11:19.445497 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 329/636] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:18 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:19.450859 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-08ed26a2-9cf5-48d5-9571-9bd09bc4db47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:19.451824 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-08ed26a2-9cf5-48d5-9571-9bd09bc4db47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:19.461878 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-08ed26a2-9cf5-48d5-9571-9bd09bc4db47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:19.462678 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-08ed26a2-9cf5-48d5-9571-9bd09bc4db47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:19.463823 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-08ed26a2-9cf5-48d5-9571-9bd09bc4db47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:19.464877 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-08ed26a2-9cf5-48d5-9571-9bd09bc4db47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:19.671779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4ac8c34f-6167-45c7-8bca-52442a2771f2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:19.683929 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4ac8c34f-6167-45c7-8bca-52442a2771f2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1277 microversion: 2.1 time: 0.513470 Oct 27 14:11:19.697912 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 308/637] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:19 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1277 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:19.963559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-25b744f7-98b8-4343-ba36-48125ac1755f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:19.964056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-25b744f7-98b8-4343-ba36-48125ac1755f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:19.982197 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25b744f7-98b8-4343-ba36-48125ac1755f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:19.982924 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25b744f7-98b8-4343-ba36-48125ac1755f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:19.985726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25b744f7-98b8-4343-ba36-48125ac1755f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:19.990682 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25b744f7-98b8-4343-ba36-48125ac1755f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:20.111585 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-25b744f7-98b8-4343-ba36-48125ac1755f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:11:20.283126 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-25b744f7-98b8-4343-ba36-48125ac1755f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 204 len: 0 microversion: 2.1 time: 0.323093 Oct 27 14:11:20.284026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 309/638] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:11:19 2021] DELETE /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:11:20.298522 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-077d75b8-7c6f-47d0-9f1e-e714f3967027 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:20.299657 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-077d75b8-7c6f-47d0-9f1e-e714f3967027 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:20.334365 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077d75b8-7c6f-47d0-9f1e-e714f3967027 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:20.335309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077d75b8-7c6f-47d0-9f1e-e714f3967027 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:20.336300 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077d75b8-7c6f-47d0-9f1e-e714f3967027 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:20.340517 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077d75b8-7c6f-47d0-9f1e-e714f3967027 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:20.451824 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-08ed26a2-9cf5-48d5-9571-9bd09bc4db47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:20.475866 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-08ed26a2-9cf5-48d5-9571-9bd09bc4db47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:20.485368 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-08ed26a2-9cf5-48d5-9571-9bd09bc4db47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:20.487381 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-08ed26a2-9cf5-48d5-9571-9bd09bc4db47 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 1.040610 Oct 27 14:11:20.495214 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 330/639] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:19 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:20.503713 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-921801793", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "networks": [{"uuid": "c0995375-e054-40e9-8e71-5bfdb80f49d9"}]}} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:20.730394 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-077d75b8-7c6f-47d0-9f1e-e714f3967027 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:20.739107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-077d75b8-7c6f-47d0-9f1e-e714f3967027 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.453689 Oct 27 14:11:20.752665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 310/640] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:20 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:20.762421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-85b88943-e4c0-4669-98c5-51c8e6c26c0b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:20.763360 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-85b88943-e4c0-4669-98c5-51c8e6c26c0b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:20.785254 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85b88943-e4c0-4669-98c5-51c8e6c26c0b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:20.785713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85b88943-e4c0-4669-98c5-51c8e6c26c0b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:20.786503 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85b88943-e4c0-4669-98c5-51c8e6c26c0b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:20.786934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85b88943-e4c0-4669-98c5-51c8e6c26c0b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:21.283466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-85b88943-e4c0-4669-98c5-51c8e6c26c0b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:21.298233 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-85b88943-e4c0-4669-98c5-51c8e6c26c0b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1515 microversion: 2.1 time: 0.544150 Oct 27 14:11:21.308670 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 311/641] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:20 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1515 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:21.314713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c1b1e357-9b3c-4ec0-bdaa-7d3058853107 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:21.314713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c1b1e357-9b3c-4ec0-bdaa-7d3058853107 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:21.332040 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1b1e357-9b3c-4ec0-bdaa-7d3058853107 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:21.332480 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1b1e357-9b3c-4ec0-bdaa-7d3058853107 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:21.333254 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1b1e357-9b3c-4ec0-bdaa-7d3058853107 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:21.333681 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1b1e357-9b3c-4ec0-bdaa-7d3058853107 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:21.662255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c1b1e357-9b3c-4ec0-bdaa-7d3058853107 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:21.671891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c1b1e357-9b3c-4ec0-bdaa-7d3058853107 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1723 microversion: 2.1 time: 0.361944 Oct 27 14:11:21.672403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 312/642] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:21 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:21.686614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-94f9c18e-53f7-46d6-959c-6cb7cc881c2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:21.695699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-94f9c18e-53f7-46d6-959c-6cb7cc881c2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:21.706828 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94f9c18e-53f7-46d6-959c-6cb7cc881c2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:21.707303 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94f9c18e-53f7-46d6-959c-6cb7cc881c2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:21.708077 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94f9c18e-53f7-46d6-959c-6cb7cc881c2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:21.708503 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94f9c18e-53f7-46d6-959c-6cb7cc881c2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:22.180414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-94f9c18e-53f7-46d6-959c-6cb7cc881c2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:22.191527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-94f9c18e-53f7-46d6-959c-6cb7cc881c2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1265 microversion: 2.1 time: 0.518038 Oct 27 14:11:22.192121 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 313/643] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:21 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1265 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:22.207160 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-4db8e873-e77a-471f-8967-961564cb0d71 req-2bf9c19f-d715-4333-9393-03a6e1012d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75d89b0d-7f54-43fe-ac03-194305453349", "tag": "2a924378-fa68-4553-8201-a655778b931a"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:22.208734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:22.208734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:11:22.219663 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-4db8e873-e77a-471f-8967-961564cb0d71 req-2bf9c19f-d715-4333-9393-03a6e1012d34 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:22.220217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-4db8e873-e77a-471f-8967-961564cb0d71 req-2bf9c19f-d715-4333-9393-03a6e1012d34 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:22.250340 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-4db8e873-e77a-471f-8967-961564cb0d71 req-2bf9c19f-d715-4333-9393-03a6e1012d34 service nova] Creating event network-changed:2a924378-fa68-4553-8201-a655778b931a for instance 75d89b0d-7f54-43fe-ac03-194305453349 on hv-cinder-81566 Oct 27 14:11:22.258224 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-4db8e873-e77a-471f-8967-961564cb0d71 req-2bf9c19f-d715-4333-9393-03a6e1012d34 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055153 Oct 27 14:11:22.267528 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 314/644] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:22.272925 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0ebab77b-4303-4aba-90b6-3c5a40d73595 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:22.273628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0ebab77b-4303-4aba-90b6-3c5a40d73595 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:22.289324 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ebab77b-4303-4aba-90b6-3c5a40d73595 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:22.289778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ebab77b-4303-4aba-90b6-3c5a40d73595 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:22.290566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ebab77b-4303-4aba-90b6-3c5a40d73595 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:22.290999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ebab77b-4303-4aba-90b6-3c5a40d73595 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:22.892316 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ebab77b-4303-4aba-90b6-3c5a40d73595 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:22.903545 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ebab77b-4303-4aba-90b6-3c5a40d73595 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:22.906243 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ebab77b-4303-4aba-90b6-3c5a40d73595 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:22.909792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0ebab77b-4303-4aba-90b6-3c5a40d73595 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1745 microversion: 2.20 time: 0.641001 Oct 27 14:11:22.911804 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 315/645] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:22 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1745 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:22.922761 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0954ea00-75c4-4254-8d15-9c888221603e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:22.927355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0954ea00-75c4-4254-8d15-9c888221603e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:22.941023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0954ea00-75c4-4254-8d15-9c888221603e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:22.941944 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0954ea00-75c4-4254-8d15-9c888221603e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:22.943050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0954ea00-75c4-4254-8d15-9c888221603e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:22.943819 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0954ea00-75c4-4254-8d15-9c888221603e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:23.252582 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0954ea00-75c4-4254-8d15-9c888221603e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:23.263867 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0954ea00-75c4-4254-8d15-9c888221603e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.350263 Oct 27 14:11:23.280369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 316/646] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:22 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:23.285413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3578ddca-a2e7-4015-b044-bd814f9c19c4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:23.286164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3578ddca-a2e7-4015-b044-bd814f9c19c4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:23.304126 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3578ddca-a2e7-4015-b044-bd814f9c19c4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:23.307219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3578ddca-a2e7-4015-b044-bd814f9c19c4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:23.308026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3578ddca-a2e7-4015-b044-bd814f9c19c4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:23.308458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3578ddca-a2e7-4015-b044-bd814f9c19c4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:23.680340 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3578ddca-a2e7-4015-b044-bd814f9c19c4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:23.694137 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3578ddca-a2e7-4015-b044-bd814f9c19c4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 200 len: 1515 microversion: 2.1 time: 0.412223 Oct 27 14:11:23.706304 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 317/647] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:23 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 1515 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:23.719507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-044fa666-bc4a-4c72-b350-75e85c76b2b8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:23.720650 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-044fa666-bc4a-4c72-b350-75e85c76b2b8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:23.737557 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-044fa666-bc4a-4c72-b350-75e85c76b2b8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:23.738129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-044fa666-bc4a-4c72-b350-75e85c76b2b8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:23.739058 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-044fa666-bc4a-4c72-b350-75e85c76b2b8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:23.750947 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-044fa666-bc4a-4c72-b350-75e85c76b2b8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:24.048986 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-044fa666-bc4a-4c72-b350-75e85c76b2b8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:24.062483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-044fa666-bc4a-4c72-b350-75e85c76b2b8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1700 microversion: 2.1 time: 0.347827 Oct 27 14:11:24.067451 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 318/648] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:23 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1700 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:24.074004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-fb5c0d7f-7107-4344-8def-d6421bc50604 req-81c46be4-8911-4413-a396-e2c6e43b0c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e12ebd-fe44-4aa9-8f5e-572d91370319", "name": "network-vif-plugged", "status": "completed", "tag": "aab79689-5599-45f7-b77c-95b865b88b1d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:24.079069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:24.079069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:11:24.097507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-fb5c0d7f-7107-4344-8def-d6421bc50604 req-81c46be4-8911-4413-a396-e2c6e43b0c2e service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:24.099743 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-fb5c0d7f-7107-4344-8def-d6421bc50604 req-81c46be4-8911-4413-a396-e2c6e43b0c2e service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:24.131292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-fb5c0d7f-7107-4344-8def-d6421bc50604 req-81c46be4-8911-4413-a396-e2c6e43b0c2e service nova] Creating event network-vif-plugged:aab79689-5599-45f7-b77c-95b865b88b1d for instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 on hv-cinder-81566 Oct 27 14:11:24.139713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-fb5c0d7f-7107-4344-8def-d6421bc50604 req-81c46be4-8911-4413-a396-e2c6e43b0c2e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070025 Oct 27 14:11:24.146218 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 319/649] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:24.160520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-138cf7e9-df43-454e-9b59-63b1ddfb1e88 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:24.163364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-138cf7e9-df43-454e-9b59-63b1ddfb1e88 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:24.179336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-138cf7e9-df43-454e-9b59-63b1ddfb1e88 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:24.180070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-138cf7e9-df43-454e-9b59-63b1ddfb1e88 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:24.182255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-138cf7e9-df43-454e-9b59-63b1ddfb1e88 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:24.183051 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-138cf7e9-df43-454e-9b59-63b1ddfb1e88 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:24.428798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-138cf7e9-df43-454e-9b59-63b1ddfb1e88 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:24.443443 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-138cf7e9-df43-454e-9b59-63b1ddfb1e88 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1265 microversion: 2.1 time: 0.294414 Oct 27 14:11:24.444065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 320/650] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:24 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:24.449243 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a2a4e369-b6cd-49f6-ba5b-a9f6591f9983 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:24.449838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a2a4e369-b6cd-49f6-ba5b-a9f6591f9983 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:24.464644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a2a4e369-b6cd-49f6-ba5b-a9f6591f9983 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:24.465399 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a2a4e369-b6cd-49f6-ba5b-a9f6591f9983 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:24.469561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a2a4e369-b6cd-49f6-ba5b-a9f6591f9983 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:24.470016 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a2a4e369-b6cd-49f6-ba5b-a9f6591f9983 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:24.692113 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.network.neutron [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] validate_networks() for [('c0995375-e054-40e9-8e71-5bfdb80f49d9', None, None, None, None, None)] {{(pid=115932) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:11:24.787746 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a2a4e369-b6cd-49f6-ba5b-a9f6591f9983 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:24.804052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a2a4e369-b6cd-49f6-ba5b-a9f6591f9983 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:24.806597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a2a4e369-b6cd-49f6-ba5b-a9f6591f9983 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:24.809450 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a2a4e369-b6cd-49f6-ba5b-a9f6591f9983 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1740 microversion: 2.20 time: 0.362427 Oct 27 14:11:24.810753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 321/651] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:24 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:24.821786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-86cb1458-b2e9-492b-9733-fad2733186bb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:24.839848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-86cb1458-b2e9-492b-9733-fad2733186bb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:24.840740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-86cb1458-b2e9-492b-9733-fad2733186bb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:24.899101 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-86cb1458-b2e9-492b-9733-fad2733186bb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Going to try to start instance {{(pid=115931) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 27 14:11:25.008176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-86cb1458-b2e9-492b-9733-fad2733186bb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 202 len: 0 microversion: 2.1 time: 0.195669 Oct 27 14:11:25.008985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 322/652] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:11:24 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:11:25.016009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3be4b878-9331-4439-b136-52c7f8fb5943 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:25.017166 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3be4b878-9331-4439-b136-52c7f8fb5943 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:25.025602 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3be4b878-9331-4439-b136-52c7f8fb5943 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:25.027645 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3be4b878-9331-4439-b136-52c7f8fb5943 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:25.028754 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3be4b878-9331-4439-b136-52c7f8fb5943 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:25.029410 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3be4b878-9331-4439-b136-52c7f8fb5943 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:25.381954 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3be4b878-9331-4439-b136-52c7f8fb5943 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:25.401504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3be4b878-9331-4439-b136-52c7f8fb5943 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.390964 Oct 27 14:11:25.402854 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 323/653] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:25 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:25.422425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d49f81f6-71b6-4c6e-98c8-a4a45916ed37 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Action: 'create', calling method: .version_select at 0x7f45707b8a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1423778766"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:25.486995 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-d49f81f6-71b6-4c6e-98c8-a4a45916ed37 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Getting quotas for project 9fb32c18000f440e88bc81eec30692b9. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:11:25.504331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-d49f81f6-71b6-4c6e-98c8-a4a45916ed37 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Getting quotas for user 7033d1e2bc6a42b88f6e06cd17251b7f and project 9fb32c18000f440e88bc81eec30692b9. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:11:25.715726 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Flavor limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:11:25.716694 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Image limits 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:11:25.718398 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Flavor pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:11:25.719029 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Image pref 0:0:0 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:11:25.719633 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.virt.hardware [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:11:25.730695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-d49f81f6-71b6-4c6e-98c8-a4a45916ed37 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Getting quotas for project 9fb32c18000f440e88bc81eec30692b9. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:11:25.734947 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-d49f81f6-71b6-4c6e-98c8-a4a45916ed37 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Getting quotas for user 7033d1e2bc6a42b88f6e06cd17251b7f and project 9fb32c18000f440e88bc81eec30692b9. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:11:25.738118 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:25.741774 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:25.742838 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:25.743493 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:25.749640 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d49f81f6-71b6-4c6e-98c8-a4a45916ed37 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.342943 Oct 27 14:11:25.750737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 324/654] 10.222.0.85 () {60 vars in 1157 bytes} [Wed Oct 27 14:11:25 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:25.755415 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-b9314919-3c7f-4e82-9beb-2bf2bf946d95 req-c626e29c-0522-4ac1-8d0f-5df19ab7922b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17894aa2-3d8b-4ce1-bd00-92e52c1825f0", "name": "network-vif-deleted", "tag": "3d0109dd-8bb8-434e-a4b1-7a4b1d7ad578"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:25.757358 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:25.757358 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:11:25.770716 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-b9314919-3c7f-4e82-9beb-2bf2bf946d95 req-c626e29c-0522-4ac1-8d0f-5df19ab7922b service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:25.771180 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-b9314919-3c7f-4e82-9beb-2bf2bf946d95 req-c626e29c-0522-4ac1-8d0f-5df19ab7922b service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:25.784864 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Getting quotas for project e557227f6d404acba108444e2f807bc2. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:11:25.790929 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.quota [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Getting quotas for user 003eebaf9aa14c90ade79784224c49a4 and project e557227f6d404acba108444e2f807bc2. Resources: {'cores', 'instances', 'ram'} {{(pid=115932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:11:25.798756 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-b9314919-3c7f-4e82-9beb-2bf2bf946d95 req-c626e29c-0522-4ac1-8d0f-5df19ab7922b service nova] Creating event network-vif-deleted:3d0109dd-8bb8-434e-a4b1-7a4b1d7ad578 for instance 17894aa2-3d8b-4ce1-bd00-92e52c1825f0 on hv-cinder-81566 Oct 27 14:11:25.804890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-b9314919-3c7f-4e82-9beb-2bf2bf946d95 req-c626e29c-0522-4ac1-8d0f-5df19ab7922b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052682 Oct 27 14:11:25.805312 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 325/655] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:25.809246 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Going to run 1 instances... {{(pid=115932) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:11:25.813657 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:11:25.814987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e3e294a2-59d8-4f04-ab85-fc4f041284ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:25.819310 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e3e294a2-59d8-4f04-ab85-fc4f041284ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 17894aa2-3d8b-4ce1-bd00-92e52c1825f0] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:25.838865 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e3e294a2-59d8-4f04-ab85-fc4f041284ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:25.839084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e3e294a2-59d8-4f04-ab85-fc4f041284ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:25.839935 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e3e294a2-59d8-4f04-ab85-fc4f041284ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:25.840373 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e3e294a2-59d8-4f04-ab85-fc4f041284ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:25.864992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-e3e294a2-59d8-4f04-ab85-fc4f041284ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] HTTP exception thrown: Instance 17894aa2-3d8b-4ce1-bd00-92e52c1825f0 could not be found. Oct 27 14:11:25.865599 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e3e294a2-59d8-4f04-ab85-fc4f041284ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Returning 404 to user: Instance 17894aa2-3d8b-4ce1-bd00-92e52c1825f0 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:11:25.866470 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e3e294a2-59d8-4f04-ab85-fc4f041284ce tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0" status: 404 len: 111 microversion: 2.1 time: 0.060062 Oct 27 14:11:25.875992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 326/656] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:25 2021] GET /compute/v2.1/servers/17894aa2-3d8b-4ce1-bd00-92e52c1825f0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:11:25.884069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b843d9bd-404d-4a06-9942-cbc42e43224a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:25.884684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b843d9bd-404d-4a06-9942-cbc42e43224a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:25.900965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b843d9bd-404d-4a06-9942-cbc42e43224a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:25.901420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b843d9bd-404d-4a06-9942-cbc42e43224a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:25.902215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b843d9bd-404d-4a06-9942-cbc42e43224a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:25.902736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b843d9bd-404d-4a06-9942-cbc42e43224a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:25.928433 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-db1b0666-48f7-4dbf-bb38-a9ecdb5df8ab tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.431390 Oct 27 14:11:25.945779 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 331/657] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:11:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 5449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:11:25.974447 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e2c4a7ff-1065-41c2-9ad0-a6a7455d53a5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:25.974971 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e2c4a7ff-1065-41c2-9ad0-a6a7455d53a5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:25.991900 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e2c4a7ff-1065-41c2-9ad0-a6a7455d53a5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:25.995622 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e2c4a7ff-1065-41c2-9ad0-a6a7455d53a5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:25.996671 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e2c4a7ff-1065-41c2-9ad0-a6a7455d53a5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:26.007652 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e2c4a7ff-1065-41c2-9ad0-a6a7455d53a5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:26.408484 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e2c4a7ff-1065-41c2-9ad0-a6a7455d53a5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:26.421531 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e2c4a7ff-1065-41c2-9ad0-a6a7455d53a5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1265 microversion: 2.1 time: 0.472592 Oct 27 14:11:26.425028 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 332/658] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:25 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1265 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:26.430880 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-18ad9efb-0127-4687-b26b-51ca686631cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:26.432459 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-18ad9efb-0127-4687-b26b-51ca686631cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:26.441417 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-18ad9efb-0127-4687-b26b-51ca686631cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:26.442633 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-18ad9efb-0127-4687-b26b-51ca686631cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:26.443740 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-18ad9efb-0127-4687-b26b-51ca686631cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:26.444870 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-18ad9efb-0127-4687-b26b-51ca686631cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:26.509385 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b843d9bd-404d-4a06-9942-cbc42e43224a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:26.524318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b843d9bd-404d-4a06-9942-cbc42e43224a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1709 microversion: 2.1 time: 0.643898 Oct 27 14:11:26.526635 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 327/659] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:25 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1709 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:26.538506 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1682348010", "imageRef": "f7339a0c-cd64-4bd9-a261-f99585d80824", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1423778766", "networks": [{"uuid": "bc4a1d58-3c4c-43bc-bad6-f8833ae92972"}]}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:27.284014 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-18ad9efb-0127-4687-b26b-51ca686631cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:27.303927 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-18ad9efb-0127-4687-b26b-51ca686631cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:27.306237 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-18ad9efb-0127-4687-b26b-51ca686631cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:27.311015 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-18ad9efb-0127-4687-b26b-51ca686631cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1740 microversion: 2.20 time: 0.884409 Oct 27 14:11:27.328565 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 333/660] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:26 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1740 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:27.340002 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-3232a2d5-95a6-466b-a2d5-32fdeab57ab7 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:27.341016 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-3232a2d5-95a6-466b-a2d5-32fdeab57ab7 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:27.348403 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3232a2d5-95a6-466b-a2d5-32fdeab57ab7 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:27.348847 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3232a2d5-95a6-466b-a2d5-32fdeab57ab7 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:27.349621 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3232a2d5-95a6-466b-a2d5-32fdeab57ab7 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:27.350204 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-3232a2d5-95a6-466b-a2d5-32fdeab57ab7 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:27.489903 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-3232a2d5-95a6-466b-a2d5-32fdeab57ab7 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:27.507661 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-3232a2d5-95a6-466b-a2d5-32fdeab57ab7 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1270 microversion: 2.1 time: 0.168175 Oct 27 14:11:27.508882 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 334/661] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:27 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:27.524958 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2b8c893f-b9aa-450b-89b4-f2a54a9e9091 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:27.525378 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2b8c893f-b9aa-450b-89b4-f2a54a9e9091 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:27.540130 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2b8c893f-b9aa-450b-89b4-f2a54a9e9091 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:27.540573 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2b8c893f-b9aa-450b-89b4-f2a54a9e9091 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:27.541353 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2b8c893f-b9aa-450b-89b4-f2a54a9e9091 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:27.541782 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2b8c893f-b9aa-450b-89b4-f2a54a9e9091 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:27.846424 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2b8c893f-b9aa-450b-89b4-f2a54a9e9091 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:27.860254 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2b8c893f-b9aa-450b-89b4-f2a54a9e9091 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.350480 Oct 27 14:11:27.861949 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 335/662] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:27 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:27.871713 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7de1a7a6-cd64-40a0-a46e-172f54f600cd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:27.874085 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7de1a7a6-cd64-40a0-a46e-172f54f600cd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:27.892545 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7de1a7a6-cd64-40a0-a46e-172f54f600cd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:27.896261 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7de1a7a6-cd64-40a0-a46e-172f54f600cd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:27.898196 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7de1a7a6-cd64-40a0-a46e-172f54f600cd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:27.900513 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7de1a7a6-cd64-40a0-a46e-172f54f600cd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:27.937095 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7de1a7a6-cd64-40a0-a46e-172f54f600cd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Going to try to terminate instance {{(pid=115932) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:11:28.142914 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7de1a7a6-cd64-40a0-a46e-172f54f600cd tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 204 len: 0 microversion: 2.1 time: 0.276009 Oct 27 14:11:28.143521 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 336/663] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:11:27 2021] DELETE /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:11:28.149310 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f8fbab3e-f99e-4518-9f4b-6a585d62a35e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:28.150475 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f8fbab3e-f99e-4518-9f4b-6a585d62a35e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:28.169140 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8fbab3e-f99e-4518-9f4b-6a585d62a35e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:28.169918 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8fbab3e-f99e-4518-9f4b-6a585d62a35e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:28.172292 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8fbab3e-f99e-4518-9f4b-6a585d62a35e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:28.172962 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8fbab3e-f99e-4518-9f4b-6a585d62a35e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:28.442190 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-f8fbab3e-f99e-4518-9f4b-6a585d62a35e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:28.453891 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f8fbab3e-f99e-4518-9f4b-6a585d62a35e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1265 microversion: 2.1 time: 0.308688 Oct 27 14:11:28.454873 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 337/664] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:28 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:28.461761 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-93420ebb-6280-47d8-b0be-152625ef9350 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:28.464462 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-93420ebb-6280-47d8-b0be-152625ef9350 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:28.476349 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-93420ebb-6280-47d8-b0be-152625ef9350 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:28.476732 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-93420ebb-6280-47d8-b0be-152625ef9350 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:28.477542 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-93420ebb-6280-47d8-b0be-152625ef9350 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:28.477978 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-93420ebb-6280-47d8-b0be-152625ef9350 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:28.788692 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-93420ebb-6280-47d8-b0be-152625ef9350 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:28.806383 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-93420ebb-6280-47d8-b0be-152625ef9350 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1709 microversion: 2.1 time: 0.350444 Oct 27 14:11:28.807204 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 338/665] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:28 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1709 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:28.812554 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8cd1d846-e0c5-430a-8396-c2b639e70a3c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:28.813168 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-8cd1d846-e0c5-430a-8396-c2b639e70a3c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:28.830103 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8cd1d846-e0c5-430a-8396-c2b639e70a3c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:28.830103 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8cd1d846-e0c5-430a-8396-c2b639e70a3c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:28.831054 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8cd1d846-e0c5-430a-8396-c2b639e70a3c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:28.831739 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8cd1d846-e0c5-430a-8396-c2b639e70a3c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:29.448793 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-8cd1d846-e0c5-430a-8396-c2b639e70a3c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:29.462475 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-8cd1d846-e0c5-430a-8396-c2b639e70a3c tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1513 microversion: 2.1 time: 0.654342 Oct 27 14:11:29.485014 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 339/666] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:28 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1513 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:29.498503 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ec6e7c11-d890-4524-abfb-36c2b125cdfd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:29.515911 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ec6e7c11-d890-4524-abfb-36c2b125cdfd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:29.541797 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec6e7c11-d890-4524-abfb-36c2b125cdfd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:29.542810 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec6e7c11-d890-4524-abfb-36c2b125cdfd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:29.544235 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec6e7c11-d890-4524-abfb-36c2b125cdfd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:29.546854 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ec6e7c11-d890-4524-abfb-36c2b125cdfd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:29.876902 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ec6e7c11-d890-4524-abfb-36c2b125cdfd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:29.894933 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ec6e7c11-d890-4524-abfb-36c2b125cdfd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:29.899443 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ec6e7c11-d890-4524-abfb-36c2b125cdfd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:29.901805 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ec6e7c11-d890-4524-abfb-36c2b125cdfd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1740 microversion: 2.20 time: 0.415477 Oct 27 14:11:29.902967 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 340/667] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:29 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1740 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:29.908887 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-78eddcda-b142-41a2-827d-6496c8139a56 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:29.910207 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-78eddcda-b142-41a2-827d-6496c8139a56 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:29.925991 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-78eddcda-b142-41a2-827d-6496c8139a56 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:29.929863 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-78eddcda-b142-41a2-827d-6496c8139a56 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:29.932916 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-78eddcda-b142-41a2-827d-6496c8139a56 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:29.942610 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-78eddcda-b142-41a2-827d-6496c8139a56 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:30.409220 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-78eddcda-b142-41a2-827d-6496c8139a56 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:30.423465 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-78eddcda-b142-41a2-827d-6496c8139a56 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.519051 Oct 27 14:11:30.424058 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 341/668] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:29 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:30.434858 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-49c096d8-ba05-437a-b5c8-1a7f7ddc9769 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:30.436146 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-49c096d8-ba05-437a-b5c8-1a7f7ddc9769 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:30.457117 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-49c096d8-ba05-437a-b5c8-1a7f7ddc9769 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:30.457824 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-49c096d8-ba05-437a-b5c8-1a7f7ddc9769 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:30.458303 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-49c096d8-ba05-437a-b5c8-1a7f7ddc9769 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:30.458756 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-49c096d8-ba05-437a-b5c8-1a7f7ddc9769 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:30.798783 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-49c096d8-ba05-437a-b5c8-1a7f7ddc9769 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:30.809599 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-49c096d8-ba05-437a-b5c8-1a7f7ddc9769 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.382220 Oct 27 14:11:30.812415 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 342/669] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:30 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:30.818478 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-fa507b7b-2673-4059-8bc2-63ac377528f5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:30.823411 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-fa507b7b-2673-4059-8bc2-63ac377528f5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:30.837138 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa507b7b-2673-4059-8bc2-63ac377528f5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:30.837948 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa507b7b-2673-4059-8bc2-63ac377528f5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:30.840157 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa507b7b-2673-4059-8bc2-63ac377528f5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:30.841760 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-fa507b7b-2673-4059-8bc2-63ac377528f5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:31.443690 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-fa507b7b-2673-4059-8bc2-63ac377528f5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:31.451231 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-fa507b7b-2673-4059-8bc2-63ac377528f5 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1265 microversion: 2.1 time: 0.637462 Oct 27 14:11:31.454240 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 343/670] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:30 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1265 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:31.464180 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a5064784-e613-4972-bf49-b56930cd6cf1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:31.465572 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a5064784-e613-4972-bf49-b56930cd6cf1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:31.471737 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a5064784-e613-4972-bf49-b56930cd6cf1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:31.472507 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a5064784-e613-4972-bf49-b56930cd6cf1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:31.473506 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a5064784-e613-4972-bf49-b56930cd6cf1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:31.474145 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a5064784-e613-4972-bf49-b56930cd6cf1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:31.939339 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a5064784-e613-4972-bf49-b56930cd6cf1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:31.947375 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a5064784-e613-4972-bf49-b56930cd6cf1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1713 microversion: 2.1 time: 0.491954 Oct 27 14:11:31.955161 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 344/671] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:31 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1713 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:31.959896 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-02a37df1-1654-446e-b2f9-1023094dee2b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:31.962526 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-02a37df1-1654-446e-b2f9-1023094dee2b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:31.985308 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-02a37df1-1654-446e-b2f9-1023094dee2b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:31.985964 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-02a37df1-1654-446e-b2f9-1023094dee2b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:31.987228 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-02a37df1-1654-446e-b2f9-1023094dee2b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:31.990844 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-02a37df1-1654-446e-b2f9-1023094dee2b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:32.108464 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-02a37df1-1654-446e-b2f9-1023094dee2b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:32.116780 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-02a37df1-1654-446e-b2f9-1023094dee2b tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 200 len: 1471 microversion: 2.1 time: 0.160436 Oct 27 14:11:32.118726 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 345/672] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:31 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:32.123387 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-8f1a0de8-5784-47c7-af5d-944b28db39be tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:32.124378 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-8f1a0de8-5784-47c7-af5d-944b28db39be tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:32.130928 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8f1a0de8-5784-47c7-af5d-944b28db39be tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:32.131698 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8f1a0de8-5784-47c7-af5d-944b28db39be tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:32.132936 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8f1a0de8-5784-47c7-af5d-944b28db39be tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:32.133549 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-8f1a0de8-5784-47c7-af5d-944b28db39be tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:32.338066 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-8f1a0de8-5784-47c7-af5d-944b28db39be tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:32.346743 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-8f1a0de8-5784-47c7-af5d-944b28db39be tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:32.355761 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-8f1a0de8-5784-47c7-af5d-944b28db39be tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:32.376602 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-8f1a0de8-5784-47c7-af5d-944b28db39be tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1740 microversion: 2.20 time: 0.256531 Oct 27 14:11:32.377309 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 346/673] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:32 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:32.382128 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-2eb022f6-92b8-4f09-843d-d2d7a90ba432 req-164e548f-fc6a-4027-9928-66df75fef382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f40bbdf7-2daa-4c43-bb64-5d7e74d23348", "tag": "aa6b322d-3edd-4f7e-8d3e-0fad55862f04"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:32.397043 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:32.397043 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:11:32.430570 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-2eb022f6-92b8-4f09-843d-d2d7a90ba432 req-164e548f-fc6a-4027-9928-66df75fef382 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:32.437061 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-2eb022f6-92b8-4f09-843d-d2d7a90ba432 req-164e548f-fc6a-4027-9928-66df75fef382 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:32.465179 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-2eb022f6-92b8-4f09-843d-d2d7a90ba432 req-164e548f-fc6a-4027-9928-66df75fef382 service nova] Creating event network-changed:aa6b322d-3edd-4f7e-8d3e-0fad55862f04 for instance f40bbdf7-2daa-4c43-bb64-5d7e74d23348 on hv-cinder-81566 Oct 27 14:11:32.485799 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-2eb022f6-92b8-4f09-843d-d2d7a90ba432 req-164e548f-fc6a-4027-9928-66df75fef382 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106975 Oct 27 14:11:32.486839 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 347/674] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:32.492844 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-6a78edf0-838d-4a0a-ac83-a491f41d6273 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:32.493806 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-6a78edf0-838d-4a0a-ac83-a491f41d6273 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:32.514658 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6a78edf0-838d-4a0a-ac83-a491f41d6273 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:32.515557 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6a78edf0-838d-4a0a-ac83-a491f41d6273 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:32.516696 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6a78edf0-838d-4a0a-ac83-a491f41d6273 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:32.517434 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-6a78edf0-838d-4a0a-ac83-a491f41d6273 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:33.097061 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-6a78edf0-838d-4a0a-ac83-a491f41d6273 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:33.130019 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-6a78edf0-838d-4a0a-ac83-a491f41d6273 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.630589 Oct 27 14:11:33.130019 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 348/675] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:32 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:33.150638 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2f6c9b9e-5dc3-46d8-a664-3f359ddb2999 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:33.151429 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2f6c9b9e-5dc3-46d8-a664-3f359ddb2999 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:33.196083 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2f6c9b9e-5dc3-46d8-a664-3f359ddb2999 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:33.210883 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2f6c9b9e-5dc3-46d8-a664-3f359ddb2999 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:33.210883 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2f6c9b9e-5dc3-46d8-a664-3f359ddb2999 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:33.210883 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2f6c9b9e-5dc3-46d8-a664-3f359ddb2999 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:33.599807 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2f6c9b9e-5dc3-46d8-a664-3f359ddb2999 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:33.619518 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2f6c9b9e-5dc3-46d8-a664-3f359ddb2999 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.497758 Oct 27 14:11:33.620352 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 349/676] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:33 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:33.654155 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-0373dca0-e8c7-4833-b03a-069a0e1500a3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:33.654989 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-0373dca0-e8c7-4833-b03a-069a0e1500a3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:33.665113 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0373dca0-e8c7-4833-b03a-069a0e1500a3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:33.667731 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0373dca0-e8c7-4833-b03a-069a0e1500a3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:33.670094 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0373dca0-e8c7-4833-b03a-069a0e1500a3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:33.674763 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-0373dca0-e8c7-4833-b03a-069a0e1500a3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:34.360391 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-0373dca0-e8c7-4833-b03a-069a0e1500a3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:34.368694 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-0373dca0-e8c7-4833-b03a-069a0e1500a3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1265 microversion: 2.1 time: 0.726690 Oct 27 14:11:34.379153 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 350/677] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:33 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1265 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:34.380556 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-48559761-c63d-4d70-b270-fd3bb36b7e34 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:34.381290 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-48559761-c63d-4d70-b270-fd3bb36b7e34 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 33d21e2b-a722-4824-b404-e0493b36c4d1] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:34.394905 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-48559761-c63d-4d70-b270-fd3bb36b7e34 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:34.395376 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-48559761-c63d-4d70-b270-fd3bb36b7e34 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:34.396172 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-48559761-c63d-4d70-b270-fd3bb36b7e34 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:34.396603 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-48559761-c63d-4d70-b270-fd3bb36b7e34 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:34.427690 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-48559761-c63d-4d70-b270-fd3bb36b7e34 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] HTTP exception thrown: Instance 33d21e2b-a722-4824-b404-e0493b36c4d1 could not be found. Oct 27 14:11:34.428516 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-48559761-c63d-4d70-b270-fd3bb36b7e34 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Returning 404 to user: Instance 33d21e2b-a722-4824-b404-e0493b36c4d1 could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:11:34.429361 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-48559761-c63d-4d70-b270-fd3bb36b7e34 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1" status: 404 len: 111 microversion: 2.1 time: 0.057522 Oct 27 14:11:34.430285 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 351/678] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:34 2021] GET /compute/v2.1/servers/33d21e2b-a722-4824-b404-e0493b36c4d1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:11:34.440386 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1f892d7b-65fb-4b2d-81d0-a33dc0de7f7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:34.441205 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1f892d7b-65fb-4b2d-81d0-a33dc0de7f7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:34.453198 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1f892d7b-65fb-4b2d-81d0-a33dc0de7f7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:34.453634 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1f892d7b-65fb-4b2d-81d0-a33dc0de7f7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:34.454433 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1f892d7b-65fb-4b2d-81d0-a33dc0de7f7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:34.454871 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1f892d7b-65fb-4b2d-81d0-a33dc0de7f7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:34.679474 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1f892d7b-65fb-4b2d-81d0-a33dc0de7f7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:34.694251 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1f892d7b-65fb-4b2d-81d0-a33dc0de7f7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:34.695686 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1f892d7b-65fb-4b2d-81d0-a33dc0de7f7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:34.696851 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1f892d7b-65fb-4b2d-81d0-a33dc0de7f7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1740 microversion: 2.20 time: 0.265369 Oct 27 14:11:34.720110 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 352/679] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:34 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1740 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:34.727190 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2105b24e-7f5b-468d-a6e0-1243cc5274ea tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:34.727807 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2105b24e-7f5b-468d-a6e0-1243cc5274ea tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:34.734791 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2105b24e-7f5b-468d-a6e0-1243cc5274ea tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:34.735176 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2105b24e-7f5b-468d-a6e0-1243cc5274ea tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:34.735910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2105b24e-7f5b-468d-a6e0-1243cc5274ea tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:34.737025 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2105b24e-7f5b-468d-a6e0-1243cc5274ea tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:35.025511 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2105b24e-7f5b-468d-a6e0-1243cc5274ea tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:35.046818 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2105b24e-7f5b-468d-a6e0-1243cc5274ea tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.324741 Oct 27 14:11:35.047715 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 353/680] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:34 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:35.052260 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-247feb8a-5176-4567-a6d4-19dbba69d51a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:35.052760 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-247feb8a-5176-4567-a6d4-19dbba69d51a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:35.074644 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-247feb8a-5176-4567-a6d4-19dbba69d51a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:35.075651 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-247feb8a-5176-4567-a6d4-19dbba69d51a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:35.076859 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-247feb8a-5176-4567-a6d4-19dbba69d51a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:35.078186 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-247feb8a-5176-4567-a6d4-19dbba69d51a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:35.124940 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-247feb8a-5176-4567-a6d4-19dbba69d51a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Going to try to terminate instance {{(pid=115932) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:11:35.271650 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-247feb8a-5176-4567-a6d4-19dbba69d51a tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 204 len: 0 microversion: 2.1 time: 0.222465 Oct 27 14:11:35.275753 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 354/681] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:11:35 2021] DELETE /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:11:35.279760 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-462d2b6d-4a0d-46a7-81bd-34f5afc9cec2 req-e4b1a095-b5de-4cf5-a2b8-d71923edda37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d21e2b-a722-4824-b404-e0493b36c4d1", "name": "network-vif-deleted", "tag": "068771a3-6b8e-4d3f-9708-0f828f723d7d"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:35.281810 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:35.281810 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:11:35.309408 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-462d2b6d-4a0d-46a7-81bd-34f5afc9cec2 req-e4b1a095-b5de-4cf5-a2b8-d71923edda37 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:35.309857 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-462d2b6d-4a0d-46a7-81bd-34f5afc9cec2 req-e4b1a095-b5de-4cf5-a2b8-d71923edda37 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:35.321675 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-462d2b6d-4a0d-46a7-81bd-34f5afc9cec2 req-e4b1a095-b5de-4cf5-a2b8-d71923edda37 service nova] Creating event network-vif-deleted:068771a3-6b8e-4d3f-9708-0f828f723d7d for instance 33d21e2b-a722-4824-b404-e0493b36c4d1 on hv-cinder-81566 Oct 27 14:11:35.333381 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-462d2b6d-4a0d-46a7-81bd-34f5afc9cec2 req-e4b1a095-b5de-4cf5-a2b8-d71923edda37 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059071 Oct 27 14:11:35.344032 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 355/682] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:35.349144 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1ac7d539-765f-48a6-8241-becd7b88f15d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:35.349910 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1ac7d539-765f-48a6-8241-becd7b88f15d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:35.368459 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1ac7d539-765f-48a6-8241-becd7b88f15d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:35.368903 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1ac7d539-765f-48a6-8241-becd7b88f15d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:35.369701 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1ac7d539-765f-48a6-8241-becd7b88f15d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:35.370145 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1ac7d539-765f-48a6-8241-becd7b88f15d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:35.520703 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1ac7d539-765f-48a6-8241-becd7b88f15d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:35.529676 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1ac7d539-765f-48a6-8241-becd7b88f15d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.184491 Oct 27 14:11:35.531212 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 356/683] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:35 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:35.538916 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-0b0e9000-b526-4d64-9287-3807df90abd6 req-f51e854f-4b24-49e9-8dea-8d480945ba5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75d89b0d-7f54-43fe-ac03-194305453349", "name": "network-vif-plugged", "status": "completed", "tag": "2a924378-fa68-4553-8201-a655778b931a"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:35.540926 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:35.540926 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:11:35.552590 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-0b0e9000-b526-4d64-9287-3807df90abd6 req-f51e854f-4b24-49e9-8dea-8d480945ba5d service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:35.553548 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-0b0e9000-b526-4d64-9287-3807df90abd6 req-f51e854f-4b24-49e9-8dea-8d480945ba5d service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:35.569519 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-0b0e9000-b526-4d64-9287-3807df90abd6 req-f51e854f-4b24-49e9-8dea-8d480945ba5d service nova] Creating event network-vif-plugged:2a924378-fa68-4553-8201-a655778b931a for instance 75d89b0d-7f54-43fe-ac03-194305453349 on hv-cinder-81566 Oct 27 14:11:35.575041 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-0b0e9000-b526-4d64-9287-3807df90abd6 req-f51e854f-4b24-49e9-8dea-8d480945ba5d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042385 Oct 27 14:11:35.575738 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 357/684] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:35.584747 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4e5b2200-7cdd-4db3-87b0-ffacddf289ad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:35.586119 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4e5b2200-7cdd-4db3-87b0-ffacddf289ad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:35.594799 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e5b2200-7cdd-4db3-87b0-ffacddf289ad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:35.595287 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e5b2200-7cdd-4db3-87b0-ffacddf289ad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:35.596087 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e5b2200-7cdd-4db3-87b0-ffacddf289ad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:35.596512 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4e5b2200-7cdd-4db3-87b0-ffacddf289ad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:35.873067 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4e5b2200-7cdd-4db3-87b0-ffacddf289ad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:35.884184 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4e5b2200-7cdd-4db3-87b0-ffacddf289ad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1513 microversion: 2.1 time: 0.303578 Oct 27 14:11:35.906346 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 358/685] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:35 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1513 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:35.911844 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-170909cc-c3d7-4fdf-88de-ba7e0edf567e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:35.912692 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-170909cc-c3d7-4fdf-88de-ba7e0edf567e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:35.923616 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-170909cc-c3d7-4fdf-88de-ba7e0edf567e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:35.925448 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-170909cc-c3d7-4fdf-88de-ba7e0edf567e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:35.930522 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-170909cc-c3d7-4fdf-88de-ba7e0edf567e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:35.931345 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-170909cc-c3d7-4fdf-88de-ba7e0edf567e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:36.274795 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-170909cc-c3d7-4fdf-88de-ba7e0edf567e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:36.294477 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-170909cc-c3d7-4fdf-88de-ba7e0edf567e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1265 microversion: 2.1 time: 0.386147 Oct 27 14:11:36.296923 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 359/686] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:35 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1265 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:36.303963 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-701315bd-c0c3-4ae4-9fc8-bf3c951678ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:36.304980 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-701315bd-c0c3-4ae4-9fc8-bf3c951678ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:36.312482 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-701315bd-c0c3-4ae4-9fc8-bf3c951678ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:36.313229 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-701315bd-c0c3-4ae4-9fc8-bf3c951678ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:36.314912 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-701315bd-c0c3-4ae4-9fc8-bf3c951678ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:36.315652 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-701315bd-c0c3-4ae4-9fc8-bf3c951678ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:36.488141 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-701315bd-c0c3-4ae4-9fc8-bf3c951678ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:36.497524 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-701315bd-c0c3-4ae4-9fc8-bf3c951678ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:36.501771 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-701315bd-c0c3-4ae4-9fc8-bf3c951678ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:36.503621 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-701315bd-c0c3-4ae4-9fc8-bf3c951678ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1740 microversion: 2.20 time: 0.204492 Oct 27 14:11:36.515293 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 360/687] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:36 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:36.520137 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-57545591-8ced-48a9-8389-37a553f15bb8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:36.520743 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-57545591-8ced-48a9-8389-37a553f15bb8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:36.528170 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57545591-8ced-48a9-8389-37a553f15bb8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:36.528616 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57545591-8ced-48a9-8389-37a553f15bb8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:36.530676 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57545591-8ced-48a9-8389-37a553f15bb8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:36.532399 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-57545591-8ced-48a9-8389-37a553f15bb8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:36.721611 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-57545591-8ced-48a9-8389-37a553f15bb8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:36.737453 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-57545591-8ced-48a9-8389-37a553f15bb8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.217738 Oct 27 14:11:36.747332 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 361/688] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:36 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:36.752281 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-dcec837c-0a79-4fb2-b500-c5f7362fba46 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:36.752836 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-dcec837c-0a79-4fb2-b500-c5f7362fba46 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:36.759552 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dcec837c-0a79-4fb2-b500-c5f7362fba46 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:36.760003 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dcec837c-0a79-4fb2-b500-c5f7362fba46 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:36.760790 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dcec837c-0a79-4fb2-b500-c5f7362fba46 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:36.761270 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-dcec837c-0a79-4fb2-b500-c5f7362fba46 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:36.924281 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-dcec837c-0a79-4fb2-b500-c5f7362fba46 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:36.937055 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-dcec837c-0a79-4fb2-b500-c5f7362fba46 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.187974 Oct 27 14:11:36.956383 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 362/689] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:36 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:36.961173 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-1e1d55f7-1c68-4cff-be1e-b666af2c72f9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:36.961863 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-1e1d55f7-1c68-4cff-be1e-b666af2c72f9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:36.978717 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e1d55f7-1c68-4cff-be1e-b666af2c72f9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:36.979200 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e1d55f7-1c68-4cff-be1e-b666af2c72f9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:36.980113 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e1d55f7-1c68-4cff-be1e-b666af2c72f9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:36.980647 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-1e1d55f7-1c68-4cff-be1e-b666af2c72f9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:37.259173 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-1e1d55f7-1c68-4cff-be1e-b666af2c72f9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:37.277763 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-1e1d55f7-1c68-4cff-be1e-b666af2c72f9 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1513 microversion: 2.1 time: 0.320096 Oct 27 14:11:37.278696 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 363/690] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:36 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1513 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:37.314246 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-76a68f79-f8aa-4b82-88f0-c31ad89cba98 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:37.314970 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-76a68f79-f8aa-4b82-88f0-c31ad89cba98 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:37.332326 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-76a68f79-f8aa-4b82-88f0-c31ad89cba98 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:37.332989 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-76a68f79-f8aa-4b82-88f0-c31ad89cba98 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:37.334579 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-76a68f79-f8aa-4b82-88f0-c31ad89cba98 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:37.334579 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-76a68f79-f8aa-4b82-88f0-c31ad89cba98 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:37.651883 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-76a68f79-f8aa-4b82-88f0-c31ad89cba98 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:37.660061 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-76a68f79-f8aa-4b82-88f0-c31ad89cba98 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1265 microversion: 2.1 time: 0.350194 Oct 27 14:11:37.660641 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 364/691] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:37 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:37.674678 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-42868e61-a33f-4c74-96c7-606b7243ceec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:37.675234 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-42868e61-a33f-4c74-96c7-606b7243ceec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:37.682505 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-42868e61-a33f-4c74-96c7-606b7243ceec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:37.683164 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-42868e61-a33f-4c74-96c7-606b7243ceec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:37.684271 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-42868e61-a33f-4c74-96c7-606b7243ceec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:37.684867 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-42868e61-a33f-4c74-96c7-606b7243ceec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:38.061763 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-42868e61-a33f-4c74-96c7-606b7243ceec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:38.075274 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-42868e61-a33f-4c74-96c7-606b7243ceec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:38.076739 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-42868e61-a33f-4c74-96c7-606b7243ceec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:38.078445 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-42868e61-a33f-4c74-96c7-606b7243ceec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1740 microversion: 2.20 time: 0.408161 Oct 27 14:11:38.089702 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 365/692] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:37 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1740 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:38.098747 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-7a881255-c5db-4136-8ac1-a3f158c2401a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:38.099167 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-7a881255-c5db-4136-8ac1-a3f158c2401a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:38.116019 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7a881255-c5db-4136-8ac1-a3f158c2401a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:38.116754 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7a881255-c5db-4136-8ac1-a3f158c2401a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:38.117691 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7a881255-c5db-4136-8ac1-a3f158c2401a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:38.118272 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-7a881255-c5db-4136-8ac1-a3f158c2401a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:38.368695 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-7a881255-c5db-4136-8ac1-a3f158c2401a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:38.377713 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-7a881255-c5db-4136-8ac1-a3f158c2401a tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.285294 Oct 27 14:11:38.390270 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 366/693] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:38 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:38.399040 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-b558020c-46d2-4a2a-9461-85ba4cbf80bc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:38.403881 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-b558020c-46d2-4a2a-9461-85ba4cbf80bc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:38.419984 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b558020c-46d2-4a2a-9461-85ba4cbf80bc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:38.420784 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b558020c-46d2-4a2a-9461-85ba4cbf80bc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:38.421957 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b558020c-46d2-4a2a-9461-85ba4cbf80bc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:38.422543 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-b558020c-46d2-4a2a-9461-85ba4cbf80bc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:38.794679 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-b558020c-46d2-4a2a-9461-85ba4cbf80bc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:38.814637 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-b558020c-46d2-4a2a-9461-85ba4cbf80bc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.422292 Oct 27 14:11:38.817244 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 367/694] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:38 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:38.823350 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:38.824083 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:38.831943 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:38.832397 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:38.833829 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:38.834265 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:38.883426 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:38.884070 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:38.884679 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.objects.instance [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lazy-loading 'fault' on Instance uuid b67be3cc-1fc7-4fc3-bdd0-03c799491784 {{(pid=115932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:11:38.935403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] validate_networks() for [('bc4a1d58-3c4c-43bc-bad6-f8833ae92972', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:11:38.936956 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:38.944864 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-4c861cdd-4f50-404d-89e3-8e9258ff2e40 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 200 len: 1307 microversion: 2.1 time: 0.126337 Oct 27 14:11:38.956107 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 368/695] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:38 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 1307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:38.961815 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-2452fce2-cc4e-4801-ac94-d1f0fa0758a7 req-5cd4486c-5845-4eae-b8ef-62024e5e6fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b67be3cc-1fc7-4fc3-bdd0-03c799491784", "name": "network-vif-deleted", "tag": "9b8b3480-396e-4f51-94d1-f326ad7aef3e"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:38.963943 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:38.963943 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:11:38.972661 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-2452fce2-cc4e-4801-ac94-d1f0fa0758a7 req-5cd4486c-5845-4eae-b8ef-62024e5e6fd9 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:38.973101 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-2452fce2-cc4e-4801-ac94-d1f0fa0758a7 req-5cd4486c-5845-4eae-b8ef-62024e5e6fd9 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:38.986696 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-2452fce2-cc4e-4801-ac94-d1f0fa0758a7 req-5cd4486c-5845-4eae-b8ef-62024e5e6fd9 service nova] Creating event network-vif-deleted:9b8b3480-396e-4f51-94d1-f326ad7aef3e for instance b67be3cc-1fc7-4fc3-bdd0-03c799491784 on hv-cinder-81566 Oct 27 14:11:38.993084 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [req-2452fce2-cc4e-4801-ac94-d1f0fa0758a7 req-5cd4486c-5845-4eae-b8ef-62024e5e6fd9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035558 Oct 27 14:11:38.993869 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 369/696] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:38.999061 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-2be7d7c5-6d25-4d52-be90-6b103a341f29 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:38.999806 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-2be7d7c5-6d25-4d52-be90-6b103a341f29 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:39.006573 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2be7d7c5-6d25-4d52-be90-6b103a341f29 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.007019 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2be7d7c5-6d25-4d52-be90-6b103a341f29 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.008128 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2be7d7c5-6d25-4d52-be90-6b103a341f29 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.008566 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-2be7d7c5-6d25-4d52-be90-6b103a341f29 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.236830 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-2be7d7c5-6d25-4d52-be90-6b103a341f29 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:39.248575 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-2be7d7c5-6d25-4d52-be90-6b103a341f29 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1451 microversion: 2.1 time: 0.253393 Oct 27 14:11:39.264063 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 370/697] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:38 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1451 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:39.269619 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-038d5459-92f0-4f7d-9604-5abb8bdb2729 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:39.270238 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-038d5459-92f0-4f7d-9604-5abb8bdb2729 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:39.278879 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-038d5459-92f0-4f7d-9604-5abb8bdb2729 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.279362 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-038d5459-92f0-4f7d-9604-5abb8bdb2729 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.280241 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-038d5459-92f0-4f7d-9604-5abb8bdb2729 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.280688 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-038d5459-92f0-4f7d-9604-5abb8bdb2729 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.589788 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-038d5459-92f0-4f7d-9604-5abb8bdb2729 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:39.600494 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-038d5459-92f0-4f7d-9604-5abb8bdb2729 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:39.602505 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-038d5459-92f0-4f7d-9604-5abb8bdb2729 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:39.603958 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-038d5459-92f0-4f7d-9604-5abb8bdb2729 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1740 microversion: 2.20 time: 0.338236 Oct 27 14:11:39.604913 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 371/698] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:39 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:39.610478 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-ee1c278c-7d79-489f-a26a-8382c76af590 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:39.611258 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-ee1c278c-7d79-489f-a26a-8382c76af590 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:39.621366 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ee1c278c-7d79-489f-a26a-8382c76af590 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.621841 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ee1c278c-7d79-489f-a26a-8382c76af590 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.622617 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ee1c278c-7d79-489f-a26a-8382c76af590 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.623043 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-ee1c278c-7d79-489f-a26a-8382c76af590 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.761890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:11:39.762579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:11:39.763125 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:11:39.763766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:11:39.764365 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:11:39.773726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.774238 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.775236 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.775748 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.800572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Getting quotas for project 9fb32c18000f440e88bc81eec30692b9. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:11:39.804984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Getting quotas for user 7033d1e2bc6a42b88f6e06cd17251b7f and project 9fb32c18000f440e88bc81eec30692b9. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:11:39.816623 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:11:39.819320 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7339a0c-cd64-4bd9-a261-f99585d80824',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:11:39.882562 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-03b83093-02a5-42f2-91b1-90f0fa58633c tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.347780 Oct 27 14:11:39.883894 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 328/699] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:11:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 13356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:11:39.888801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cf6b3a4b-3c10-4c01-9de3-ad1bd5fac62d tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:39.889644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cf6b3a4b-3c10-4c01-9de3-ad1bd5fac62d tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:39.910594 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-ee1c278c-7d79-489f-a26a-8382c76af590 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:39.914182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf6b3a4b-3c10-4c01-9de3-ad1bd5fac62d tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.914182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf6b3a4b-3c10-4c01-9de3-ad1bd5fac62d tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.914504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf6b3a4b-3c10-4c01-9de3-ad1bd5fac62d tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.914888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf6b3a4b-3c10-4c01-9de3-ad1bd5fac62d tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.917968 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-ee1c278c-7d79-489f-a26a-8382c76af590 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1451 microversion: 2.1 time: 0.311969 Oct 27 14:11:39.921583 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 372/700] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:39 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1451 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:39.947765 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-a64cdcae-3326-4a2f-b075-751366a77e5e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:39.951638 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-a64cdcae-3326-4a2f-b075-751366a77e5e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:39.967525 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a64cdcae-3326-4a2f-b075-751366a77e5e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.968532 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a64cdcae-3326-4a2f-b075-751366a77e5e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:39.969488 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a64cdcae-3326-4a2f-b075-751366a77e5e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:39.970141 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-a64cdcae-3326-4a2f-b075-751366a77e5e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:40.312141 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-cf6b3a4b-3c10-4c01-9de3-ad1bd5fac62d tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:40.319861 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-a64cdcae-3326-4a2f-b075-751366a77e5e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:40.320938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cf6b3a4b-3c10-4c01-9de3-ad1bd5fac62d tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.435508 Oct 27 14:11:40.322045 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 329/701] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:39 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:40.328256 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dddc29ce-d63c-4eed-b3d0-bae99f362676 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:40.329000 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dddc29ce-d63c-4eed-b3d0-bae99f362676 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:40.330124 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-a64cdcae-3326-4a2f-b075-751366a77e5e tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.407214 Oct 27 14:11:40.330926 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 373/702] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:39 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:40.335761 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d4d3d788-c34e-4aa7-ab01-2f6144410d96 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:40.337207 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-d4d3d788-c34e-4aa7-ab01-2f6144410d96 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: b67be3cc-1fc7-4fc3-bdd0-03c799491784] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:40.347802 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d4d3d788-c34e-4aa7-ab01-2f6144410d96 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:40.348534 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d4d3d788-c34e-4aa7-ab01-2f6144410d96 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:40.355252 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d4d3d788-c34e-4aa7-ab01-2f6144410d96 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:40.355866 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-d4d3d788-c34e-4aa7-ab01-2f6144410d96 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:40.372572 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.wsgi [None req-d4d3d788-c34e-4aa7-ab01-2f6144410d96 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] HTTP exception thrown: Instance b67be3cc-1fc7-4fc3-bdd0-03c799491784 could not be found. Oct 27 14:11:40.373426 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-d4d3d788-c34e-4aa7-ab01-2f6144410d96 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Returning 404 to user: Instance b67be3cc-1fc7-4fc3-bdd0-03c799491784 could not be found. {{(pid=115932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:11:40.374540 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-d4d3d788-c34e-4aa7-ab01-2f6144410d96 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784" status: 404 len: 111 microversion: 2.1 time: 0.042529 Oct 27 14:11:40.378697 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 374/703] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:40 2021] GET /compute/v2.1/servers/b67be3cc-1fc7-4fc3-bdd0-03c799491784 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:11:40.408375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-dddc29ce-d63c-4eed-b3d0-bae99f362676 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:40.415688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dddc29ce-d63c-4eed-b3d0-bae99f362676 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1259 microversion: 2.1 time: 0.092439 Oct 27 14:11:40.416181 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 330/704] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:40 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1259 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:40.622327 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e551e155-7f69-4ead-83d6-e80cf0842d85 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:40.622968 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e551e155-7f69-4ead-83d6-e80cf0842d85 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:40.631262 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e551e155-7f69-4ead-83d6-e80cf0842d85 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:40.631694 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e551e155-7f69-4ead-83d6-e80cf0842d85 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:40.632477 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e551e155-7f69-4ead-83d6-e80cf0842d85 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:40.633169 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e551e155-7f69-4ead-83d6-e80cf0842d85 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:40.829521 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e551e155-7f69-4ead-83d6-e80cf0842d85 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:40.838552 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e551e155-7f69-4ead-83d6-e80cf0842d85 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:40.840694 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e551e155-7f69-4ead-83d6-e80cf0842d85 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:40.841388 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e551e155-7f69-4ead-83d6-e80cf0842d85 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1722 microversion: 2.20 time: 0.222973 Oct 27 14:11:40.855220 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 375/705] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:40 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:41.338683 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4fd0d5df-8db5-4a80-be38-ba8b3b3c8de8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:41.339525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4fd0d5df-8db5-4a80-be38-ba8b3b3c8de8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:41.348146 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fd0d5df-8db5-4a80-be38-ba8b3b3c8de8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.348458 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-46c44972-5ebd-4c22-9ff7-16f4967a1a92 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:41.349079 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-46c44972-5ebd-4c22-9ff7-16f4967a1a92 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:41.350397 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fd0d5df-8db5-4a80-be38-ba8b3b3c8de8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.352651 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fd0d5df-8db5-4a80-be38-ba8b3b3c8de8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.353170 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fd0d5df-8db5-4a80-be38-ba8b3b3c8de8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.358627 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-46c44972-5ebd-4c22-9ff7-16f4967a1a92 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.359082 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-46c44972-5ebd-4c22-9ff7-16f4967a1a92 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.364127 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-46c44972-5ebd-4c22-9ff7-16f4967a1a92 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.366815 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-46c44972-5ebd-4c22-9ff7-16f4967a1a92 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.692892 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4fd0d5df-8db5-4a80-be38-ba8b3b3c8de8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:41.704037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4fd0d5df-8db5-4a80-be38-ba8b3b3c8de8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.369454 Oct 27 14:11:41.705436 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 331/706] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:41 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:41.705989 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-46c44972-5ebd-4c22-9ff7-16f4967a1a92 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:41.710687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-785508e0-0414-4c0d-8469-e8ac90847ecd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:41.711601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-785508e0-0414-4c0d-8469-e8ac90847ecd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:41.714227 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-46c44972-5ebd-4c22-9ff7-16f4967a1a92 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.370085 Oct 27 14:11:41.714809 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 376/707] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:41 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:41.720346 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-f8ef77a9-8e98-4cde-b2e6-e0d63644fee2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:41.721073 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f8ef77a9-8e98-4cde-b2e6-e0d63644fee2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:41.727889 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8ef77a9-8e98-4cde-b2e6-e0d63644fee2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.728633 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8ef77a9-8e98-4cde-b2e6-e0d63644fee2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.729599 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8ef77a9-8e98-4cde-b2e6-e0d63644fee2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.730193 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-f8ef77a9-8e98-4cde-b2e6-e0d63644fee2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.739517 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-785508e0-0414-4c0d-8469-e8ac90847ecd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.740215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-785508e0-0414-4c0d-8469-e8ac90847ecd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.741149 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-785508e0-0414-4c0d-8469-e8ac90847ecd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.741749 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-785508e0-0414-4c0d-8469-e8ac90847ecd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.761248 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-f8ef77a9-8e98-4cde-b2e6-e0d63644fee2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Going to try to terminate instance {{(pid=115932) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:11:41.844511 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-785508e0-0414-4c0d-8469-e8ac90847ecd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:41.853375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-785508e0-0414-4c0d-8469-e8ac90847ecd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1317 microversion: 2.1 time: 0.146435 Oct 27 14:11:41.854679 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 332/708] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:41 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:41.859806 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5dbc1a34-ec71-4a4c-9ed8-27336ffefadb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:41.860406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5dbc1a34-ec71-4a4c-9ed8-27336ffefadb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:41.878965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5dbc1a34-ec71-4a4c-9ed8-27336ffefadb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.879834 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5dbc1a34-ec71-4a4c-9ed8-27336ffefadb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.881359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5dbc1a34-ec71-4a4c-9ed8-27336ffefadb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.882023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5dbc1a34-ec71-4a4c-9ed8-27336ffefadb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.900066 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-f8ef77a9-8e98-4cde-b2e6-e0d63644fee2 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 204 len: 0 microversion: 2.1 time: 0.183987 Oct 27 14:11:41.918477 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 377/709] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:11:41 2021] DELETE /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:11:41.931888 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e213a8a8-6fa2-4e97-af62-2539dbda5268 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:41.935402 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e213a8a8-6fa2-4e97-af62-2539dbda5268 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:41.945145 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e213a8a8-6fa2-4e97-af62-2539dbda5268 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.947226 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e213a8a8-6fa2-4e97-af62-2539dbda5268 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:41.948736 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e213a8a8-6fa2-4e97-af62-2539dbda5268 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:41.950719 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e213a8a8-6fa2-4e97-af62-2539dbda5268 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:42.229591 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5dbc1a34-ec71-4a4c-9ed8-27336ffefadb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:42.240772 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5dbc1a34-ec71-4a4c-9ed8-27336ffefadb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:42.242454 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5dbc1a34-ec71-4a4c-9ed8-27336ffefadb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:42.260160 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5dbc1a34-ec71-4a4c-9ed8-27336ffefadb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1722 microversion: 2.20 time: 0.403770 Oct 27 14:11:42.261332 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 333/710] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:41 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:42.275385 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e213a8a8-6fa2-4e97-af62-2539dbda5268 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:42.302298 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e213a8a8-6fa2-4e97-af62-2539dbda5268 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1513 microversion: 2.1 time: 0.381248 Oct 27 14:11:42.304431 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 378/711] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:41 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1513 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:42.672401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-c29173f3-aed4-4e8f-b00d-b453558ca8f0 req-8ea51973-c93b-4512-aec7-a4b3830e8f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75d89b0d-7f54-43fe-ac03-194305453349", "tag": "2a924378-fa68-4553-8201-a655778b931a"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:42.674705 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:42.674705 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:11:42.687737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-c29173f3-aed4-4e8f-b00d-b453558ca8f0 req-8ea51973-c93b-4512-aec7-a4b3830e8f41 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:42.687737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-c29173f3-aed4-4e8f-b00d-b453558ca8f0 req-8ea51973-c93b-4512-aec7-a4b3830e8f41 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:42.722067 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-297d0229-bf1a-4ac5-9fae-e4e0a7044243 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:42.723858 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-297d0229-bf1a-4ac5-9fae-e4e0a7044243 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:42.731274 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-c29173f3-aed4-4e8f-b00d-b453558ca8f0 req-8ea51973-c93b-4512-aec7-a4b3830e8f41 service nova] Creating event network-changed:2a924378-fa68-4553-8201-a655778b931a for instance 75d89b0d-7f54-43fe-ac03-194305453349 on hv-cinder-81566 Oct 27 14:11:42.735166 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-297d0229-bf1a-4ac5-9fae-e4e0a7044243 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:42.737027 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-297d0229-bf1a-4ac5-9fae-e4e0a7044243 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:42.744382 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-297d0229-bf1a-4ac5-9fae-e4e0a7044243 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:42.745161 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-297d0229-bf1a-4ac5-9fae-e4e0a7044243 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:42.747829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-c29173f3-aed4-4e8f-b00d-b453558ca8f0 req-8ea51973-c93b-4512-aec7-a4b3830e8f41 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079730 Oct 27 14:11:42.752984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 334/712] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:11:42.789072 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0c3309c8-6127-41a9-a4b4-bdd5111a5b07 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:42.789843 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0c3309c8-6127-41a9-a4b4-bdd5111a5b07 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:42.816271 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0c3309c8-6127-41a9-a4b4-bdd5111a5b07 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:42.819379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0c3309c8-6127-41a9-a4b4-bdd5111a5b07 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:42.822576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0c3309c8-6127-41a9-a4b4-bdd5111a5b07 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:42.822831 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0c3309c8-6127-41a9-a4b4-bdd5111a5b07 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:43.415399 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0c3309c8-6127-41a9-a4b4-bdd5111a5b07 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:43.432714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0c3309c8-6127-41a9-a4b4-bdd5111a5b07 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1567 microversion: 2.1 time: 0.678395 Oct 27 14:11:43.433357 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 335/713] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:42 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1567 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:43.447911 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-297d0229-bf1a-4ac5-9fae-e4e0a7044243 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:43.465567 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-297d0229-bf1a-4ac5-9fae-e4e0a7044243 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.747906 Oct 27 14:11:43.469264 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a1724978-758d-430b-95fb-c4e5281b9cde tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:43.474851 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a1724978-758d-430b-95fb-c4e5281b9cde tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:43.478929 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 379/714] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:42 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:43.501348 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-153b7bfe-9e08-41e7-bf01-e5be382337ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:43.503053 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a1724978-758d-430b-95fb-c4e5281b9cde tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:43.508476 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-153b7bfe-9e08-41e7-bf01-e5be382337ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:43.509341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a1724978-758d-430b-95fb-c4e5281b9cde tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:43.510377 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a1724978-758d-430b-95fb-c4e5281b9cde tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:43.511638 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a1724978-758d-430b-95fb-c4e5281b9cde tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:43.525523 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-153b7bfe-9e08-41e7-bf01-e5be382337ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:43.541004 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-153b7bfe-9e08-41e7-bf01-e5be382337ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:43.542142 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-153b7bfe-9e08-41e7-bf01-e5be382337ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:43.549314 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-153b7bfe-9e08-41e7-bf01-e5be382337ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:44.149553 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-153b7bfe-9e08-41e7-bf01-e5be382337ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:44.160058 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-153b7bfe-9e08-41e7-bf01-e5be382337ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:44.166157 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-153b7bfe-9e08-41e7-bf01-e5be382337ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:44.175425 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-153b7bfe-9e08-41e7-bf01-e5be382337ff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1722 microversion: 2.20 time: 0.695072 Oct 27 14:11:44.186601 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 380/715] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:43 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1722 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:44.191271 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-76844bdc-fce7-4718-acd3-515f57afa4d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:44.191880 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-76844bdc-fce7-4718-acd3-515f57afa4d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:44.198080 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a1724978-758d-430b-95fb-c4e5281b9cde tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:44.204831 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-76844bdc-fce7-4718-acd3-515f57afa4d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:44.209672 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-76844bdc-fce7-4718-acd3-515f57afa4d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:44.212101 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a1724978-758d-430b-95fb-c4e5281b9cde tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.772560 Oct 27 14:11:44.212899 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-76844bdc-fce7-4718-acd3-515f57afa4d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:44.213566 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-76844bdc-fce7-4718-acd3-515f57afa4d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:44.216915 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 336/716] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:43 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:44.231999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-f46b1e12-ce87-4773-bde2-44e61462e8fc req-0152a92e-28c9-450f-960a-a371acaae21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e12ebd-fe44-4aa9-8f5e-572d91370319", "name": "network-vif-unplugged", "status": "completed", "tag": "aab79689-5599-45f7-b77c-95b865b88b1d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:44.234256 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:44.234256 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:11:44.249328 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-f46b1e12-ce87-4773-bde2-44e61462e8fc req-0152a92e-28c9-450f-960a-a371acaae21d service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:44.252064 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-f46b1e12-ce87-4773-bde2-44e61462e8fc req-0152a92e-28c9-450f-960a-a371acaae21d service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:44.278147 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-f46b1e12-ce87-4773-bde2-44e61462e8fc req-0152a92e-28c9-450f-960a-a371acaae21d service nova] Creating event network-vif-unplugged:aab79689-5599-45f7-b77c-95b865b88b1d for instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 on hv-cinder-81566 Oct 27 14:11:44.291796 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-f46b1e12-ce87-4773-bde2-44e61462e8fc req-0152a92e-28c9-450f-960a-a371acaae21d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064153 Oct 27 14:11:44.292792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 337/717] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:44.451225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ccc2916b-c511-458a-aace-128428e67fbd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:44.452010 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ccc2916b-c511-458a-aace-128428e67fbd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:44.473325 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ccc2916b-c511-458a-aace-128428e67fbd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:44.473869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ccc2916b-c511-458a-aace-128428e67fbd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:44.474742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ccc2916b-c511-458a-aace-128428e67fbd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:44.475278 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ccc2916b-c511-458a-aace-128428e67fbd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:44.964067 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-76844bdc-fce7-4718-acd3-515f57afa4d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:44.976048 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-76844bdc-fce7-4718-acd3-515f57afa4d4 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1513 microversion: 2.1 time: 0.788256 Oct 27 14:11:44.979868 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 381/718] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:44 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1513 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:44.991686 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-e09e97f7-3ef3-42ea-9cdf-5eb767f69fa2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:44.992717 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-e09e97f7-3ef3-42ea-9cdf-5eb767f69fa2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:45.009161 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e09e97f7-3ef3-42ea-9cdf-5eb767f69fa2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.009942 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e09e97f7-3ef3-42ea-9cdf-5eb767f69fa2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.010962 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e09e97f7-3ef3-42ea-9cdf-5eb767f69fa2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.012664 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-e09e97f7-3ef3-42ea-9cdf-5eb767f69fa2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.278832 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ccc2916b-c511-458a-aace-128428e67fbd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:45.295788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ccc2916b-c511-458a-aace-128428e67fbd tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1547 microversion: 2.1 time: 0.848670 Oct 27 14:11:45.297312 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 338/719] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:44 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1547 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:45.338362 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-07df72c4-5007-433c-9901-9ffc0ca0f750 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:45.339084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-07df72c4-5007-433c-9901-9ffc0ca0f750 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:45.349763 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07df72c4-5007-433c-9901-9ffc0ca0f750 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.351573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07df72c4-5007-433c-9901-9ffc0ca0f750 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.352573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07df72c4-5007-433c-9901-9ffc0ca0f750 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.355737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-07df72c4-5007-433c-9901-9ffc0ca0f750 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.552797 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-e09e97f7-3ef3-42ea-9cdf-5eb767f69fa2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:45.564666 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-e09e97f7-3ef3-42ea-9cdf-5eb767f69fa2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.583101 Oct 27 14:11:45.576828 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 382/720] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:44 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:45.584123 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [None req-246fc665-7dcb-47c7-bf41-f8366ca21bc9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:45.585350 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.compute.api [None req-246fc665-7dcb-47c7-bf41-f8366ca21bc9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115932) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:45.604175 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-246fc665-7dcb-47c7-bf41-f8366ca21bc9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.611863 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-246fc665-7dcb-47c7-bf41-f8366ca21bc9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.613197 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-246fc665-7dcb-47c7-bf41-f8366ca21bc9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.613848 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [None req-246fc665-7dcb-47c7-bf41-f8366ca21bc9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.754729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-07df72c4-5007-433c-9901-9ffc0ca0f750 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:45.767982 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-07df72c4-5007-433c-9901-9ffc0ca0f750 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:45.770824 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-07df72c4-5007-433c-9901-9ffc0ca0f750 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:45.772676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-07df72c4-5007-433c-9901-9ffc0ca0f750 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1722 microversion: 2.20 time: 0.458477 Oct 27 14:11:45.774031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 339/721] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:45 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1722 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:45.779564 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9100f8ac-81d9-476c-80b3-7637d92e4397 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:45.780066 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9100f8ac-81d9-476c-80b3-7637d92e4397 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:45.787525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9100f8ac-81d9-476c-80b3-7637d92e4397 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.788263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9100f8ac-81d9-476c-80b3-7637d92e4397 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.789246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9100f8ac-81d9-476c-80b3-7637d92e4397 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.790371 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9100f8ac-81d9-476c-80b3-7637d92e4397 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.912120 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.policy [None req-246fc665-7dcb-47c7-bf41-f8366ca21bc9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115932) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:45.919469 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.requestlog [None req-246fc665-7dcb-47c7-bf41-f8366ca21bc9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.340576 Oct 27 14:11:45.920045 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: [pid: 115932|app: 0|req: 383/722] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:45 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:45.942233 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG nova.api.openstack.wsgi [req-1a646d35-9d51-4546-bdeb-f551b0608882 req-4f59c752-5d33-4296-abba-642386106092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d115154-f737-44a1-83d0-3ed7b44ab9f5", "tag": "d7dbd7ad-d681-4b28-a600-73b66f728573"}]} {{(pid=115932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:45.949884 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:45.949884 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: warnings.warn(msg) Oct 27 14:11:45.950202 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-9100f8ac-81d9-476c-80b3-7637d92e4397 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] HTTP exception thrown: Cannot 'detach_volume' instance adbc567f-bc87-48cd-b910-ba46c84f914d while it is in vm_state rescued Oct 27 14:11:45.950556 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9100f8ac-81d9-476c-80b3-7637d92e4397 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Returning 409 to user: Cannot 'detach_volume' instance adbc567f-bc87-48cd-b910-ba46c84f914d while it is in vm_state rescued {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:11:45.953297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9100f8ac-81d9-476c-80b3-7637d92e4397 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "DELETE /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments/61bb5062-3b9f-4d73-86f4-804c02cb5486" status: 409 len: 152 microversion: 2.1 time: 0.176145 Oct 27 14:11:45.954736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 340/723] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:11:45 2021] DELETE /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments/61bb5062-3b9f-4d73-86f4-804c02cb5486 => generated 152 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 14:11:45.961352 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-1a646d35-9d51-4546-bdeb-f551b0608882 req-4f59c752-5d33-4296-abba-642386106092 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.961789 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: DEBUG oslo_concurrency.lockutils [req-1a646d35-9d51-4546-bdeb-f551b0608882 req-4f59c752-5d33-4296-abba-642386106092 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.968391 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bfb25c42-bea2-4034-abde-b90904631256 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:45.969463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-bfb25c42-bea2-4034-abde-b90904631256 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:45.977297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bfb25c42-bea2-4034-abde-b90904631256 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.977679 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bfb25c42-bea2-4034-abde-b90904631256 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.978726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bfb25c42-bea2-4034-abde-b90904631256 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:45.978934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bfb25c42-bea2-4034-abde-b90904631256 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:45.991076 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO nova.api.openstack.compute.server_external_events [req-1a646d35-9d51-4546-bdeb-f551b0608882 req-4f59c752-5d33-4296-abba-642386106092 service nova] Creating event network-changed:d7dbd7ad-d681-4b28-a600-73b66f728573 for instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 on hv-cinder-81566 Oct 27 14:11:45.995612 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:11:45.997698 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Wed Oct 27 14:11:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Oct 27 14:11:46.019600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Traceback (most recent call last): Oct 27 14:11:46.019600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Oct 27 14:11:46.019600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: timer() Oct 27 14:11:46.019600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Oct 27 14:11:46.019600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: cb(*args, **kw) Oct 27 14:11:46.019600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 152, in _do_acquire Oct 27 14:11:46.019600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: waiter.switch() Oct 27 14:11:46.019600 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: greenlet.error: cannot switch to a different thread Oct 27 14:11:46.078327 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bfb25c42-bea2-4034-abde-b90904631256 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/action" status: 202 len: 0 microversion: 2.1 time: 0.116348 Oct 27 14:11:46.079155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 341/724] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:11:45 2021] POST /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:11:46.085527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-41d25e16-3545-4702-a75f-c22eeb7b5ae6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:46.086224 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-41d25e16-3545-4702-a75f-c22eeb7b5ae6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:46.093805 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41d25e16-3545-4702-a75f-c22eeb7b5ae6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:46.094273 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41d25e16-3545-4702-a75f-c22eeb7b5ae6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:46.095063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41d25e16-3545-4702-a75f-c22eeb7b5ae6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:46.095534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41d25e16-3545-4702-a75f-c22eeb7b5ae6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:46.251271 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-41d25e16-3545-4702-a75f-c22eeb7b5ae6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:46.259089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-41d25e16-3545-4702-a75f-c22eeb7b5ae6 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1513 microversion: 2.1 time: 0.178374 Oct 27 14:11:46.269397 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 342/725] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:46 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:46.274322 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9300c9e3-8f17-4a40-a371-729031fb694b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:46.275191 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9300c9e3-8f17-4a40-a371-729031fb694b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:46.282420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9300c9e3-8f17-4a40-a371-729031fb694b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:46.283047 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9300c9e3-8f17-4a40-a371-729031fb694b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:46.283678 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9300c9e3-8f17-4a40-a371-729031fb694b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:46.284113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9300c9e3-8f17-4a40-a371-729031fb694b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:46.470788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9300c9e3-8f17-4a40-a371-729031fb694b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:46.479712 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9300c9e3-8f17-4a40-a371-729031fb694b tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1555 microversion: 2.1 time: 0.208857 Oct 27 14:11:46.480309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 343/726] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:46 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:46.585641 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a764da97-5a01-4a3e-846d-0e84e7048ca2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:46.586255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a764da97-5a01-4a3e-846d-0e84e7048ca2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:46.592730 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a764da97-5a01-4a3e-846d-0e84e7048ca2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:46.594079 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a764da97-5a01-4a3e-846d-0e84e7048ca2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:46.596457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a764da97-5a01-4a3e-846d-0e84e7048ca2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:46.597131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a764da97-5a01-4a3e-846d-0e84e7048ca2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:46.766309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a764da97-5a01-4a3e-846d-0e84e7048ca2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:46.774845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a764da97-5a01-4a3e-846d-0e84e7048ca2 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.195173 Oct 27 14:11:46.779283 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 344/727] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:46 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:46.793678 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cbec1d8c-ffaf-4631-872a-f4bf0c7da4bd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:46.794562 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cbec1d8c-ffaf-4631-872a-f4bf0c7da4bd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:46.804415 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbec1d8c-ffaf-4631-872a-f4bf0c7da4bd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:46.804904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbec1d8c-ffaf-4631-872a-f4bf0c7da4bd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:46.805838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbec1d8c-ffaf-4631-872a-f4bf0c7da4bd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:46.806275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbec1d8c-ffaf-4631-872a-f4bf0c7da4bd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:47.018187 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-cbec1d8c-ffaf-4631-872a-f4bf0c7da4bd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:47.026803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-cbec1d8c-ffaf-4631-872a-f4bf0c7da4bd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:47.028541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-cbec1d8c-ffaf-4631-872a-f4bf0c7da4bd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:47.029928 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cbec1d8c-ffaf-4631-872a-f4bf0c7da4bd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1722 microversion: 2.20 time: 0.240483 Oct 27 14:11:47.031914 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 345/728] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:46 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:47.039558 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-45de4bf7-417e-4366-8849-36e699da684a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:47.041041 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-45de4bf7-417e-4366-8849-36e699da684a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:47.049821 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45de4bf7-417e-4366-8849-36e699da684a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:47.050607 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45de4bf7-417e-4366-8849-36e699da684a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:47.052050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45de4bf7-417e-4366-8849-36e699da684a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:47.052683 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45de4bf7-417e-4366-8849-36e699da684a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:47.231526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-45de4bf7-417e-4366-8849-36e699da684a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:47.240675 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-45de4bf7-417e-4366-8849-36e699da684a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.207830 Oct 27 14:11:47.242119 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 346/729] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:47 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:47.247435 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-db75e34c-fc45-48d2-b0fa-9ba5a954ed93 req-85b66a4c-5dba-41d8-91b5-2276d63f5a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f40bbdf7-2daa-4c43-bb64-5d7e74d23348", "name": "network-vif-plugged", "status": "completed", "tag": "aa6b322d-3edd-4f7e-8d3e-0fad55862f04"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:47.249804 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:11:47.249804 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:11:47.259087 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-db75e34c-fc45-48d2-b0fa-9ba5a954ed93 req-85b66a4c-5dba-41d8-91b5-2276d63f5a8c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:47.259924 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-db75e34c-fc45-48d2-b0fa-9ba5a954ed93 req-85b66a4c-5dba-41d8-91b5-2276d63f5a8c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:47.274214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-db75e34c-fc45-48d2-b0fa-9ba5a954ed93 req-85b66a4c-5dba-41d8-91b5-2276d63f5a8c service nova] Creating event network-vif-plugged:aa6b322d-3edd-4f7e-8d3e-0fad55862f04 for instance f40bbdf7-2daa-4c43-bb64-5d7e74d23348 on hv-cinder-81566 Oct 27 14:11:47.282067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-db75e34c-fc45-48d2-b0fa-9ba5a954ed93 req-85b66a4c-5dba-41d8-91b5-2276d63f5a8c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038809 Oct 27 14:11:47.283396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 347/730] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:11:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:11:47.298243 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8edea352-8acb-415f-a2f9-77de7559d3c1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:47.299347 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8edea352-8acb-415f-a2f9-77de7559d3c1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:47.308193 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8edea352-8acb-415f-a2f9-77de7559d3c1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:47.308870 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8edea352-8acb-415f-a2f9-77de7559d3c1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:47.309693 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8edea352-8acb-415f-a2f9-77de7559d3c1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:47.310283 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8edea352-8acb-415f-a2f9-77de7559d3c1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:47.555907 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8edea352-8acb-415f-a2f9-77de7559d3c1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:47.564520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8edea352-8acb-415f-a2f9-77de7559d3c1 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1513 microversion: 2.1 time: 0.279076 Oct 27 14:11:47.565307 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 348/731] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:47 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:47.569784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f2594fd0-2cc4-41ed-886c-d69234e11771 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:47.575528 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f2594fd0-2cc4-41ed-886c-d69234e11771 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:47.583242 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2594fd0-2cc4-41ed-886c-d69234e11771 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:47.583791 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2594fd0-2cc4-41ed-886c-d69234e11771 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:47.585137 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2594fd0-2cc4-41ed-886c-d69234e11771 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:47.585137 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f2594fd0-2cc4-41ed-886c-d69234e11771 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:47.747975 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f2594fd0-2cc4-41ed-886c-d69234e11771 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:47.757105 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f2594fd0-2cc4-41ed-886c-d69234e11771 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1555 microversion: 2.1 time: 0.190884 Oct 27 14:11:47.757907 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 349/732] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:47 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:47.810160 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8e54ed41-0456-4c5b-9575-67171dd89d48 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:47.811090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8e54ed41-0456-4c5b-9575-67171dd89d48 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:47.826873 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8e54ed41-0456-4c5b-9575-67171dd89d48 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:47.827296 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8e54ed41-0456-4c5b-9575-67171dd89d48 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:47.828090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8e54ed41-0456-4c5b-9575-67171dd89d48 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:47.829948 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8e54ed41-0456-4c5b-9575-67171dd89d48 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:48.047314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8e54ed41-0456-4c5b-9575-67171dd89d48 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:48.060714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8e54ed41-0456-4c5b-9575-67171dd89d48 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.260680 Oct 27 14:11:48.061323 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 350/733] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:47 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:48.067109 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5dcfb196-47ba-48cc-8a8a-50433cd645d2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:48.068636 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5dcfb196-47ba-48cc-8a8a-50433cd645d2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:48.081699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5dcfb196-47ba-48cc-8a8a-50433cd645d2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:48.082152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5dcfb196-47ba-48cc-8a8a-50433cd645d2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:48.083645 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5dcfb196-47ba-48cc-8a8a-50433cd645d2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:48.084087 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5dcfb196-47ba-48cc-8a8a-50433cd645d2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:48.335561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5dcfb196-47ba-48cc-8a8a-50433cd645d2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:48.353469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5dcfb196-47ba-48cc-8a8a-50433cd645d2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:48.356218 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5dcfb196-47ba-48cc-8a8a-50433cd645d2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:48.357888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5dcfb196-47ba-48cc-8a8a-50433cd645d2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1722 microversion: 2.20 time: 0.294456 Oct 27 14:11:48.359579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 351/734] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:48 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:48.365258 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f28001bf-2dc9-46e1-9826-87755efaddb7 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:48.366309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f28001bf-2dc9-46e1-9826-87755efaddb7 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:48.391951 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f28001bf-2dc9-46e1-9826-87755efaddb7 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:48.393108 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f28001bf-2dc9-46e1-9826-87755efaddb7 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:48.394302 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f28001bf-2dc9-46e1-9826-87755efaddb7 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:48.396435 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f28001bf-2dc9-46e1-9826-87755efaddb7 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:48.632157 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f28001bf-2dc9-46e1-9826-87755efaddb7 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:48.641933 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f28001bf-2dc9-46e1-9826-87755efaddb7 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.280792 Oct 27 14:11:48.652127 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 352/735] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:48 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:48.673324 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-33d53d9e-32e8-46ab-a9bc-fc71cc1fc823 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:48.673660 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-33d53d9e-32e8-46ab-a9bc-fc71cc1fc823 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:48.708308 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-33d53d9e-32e8-46ab-a9bc-fc71cc1fc823 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:48.708775 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-33d53d9e-32e8-46ab-a9bc-fc71cc1fc823 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:48.710797 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-33d53d9e-32e8-46ab-a9bc-fc71cc1fc823 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:48.711590 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-33d53d9e-32e8-46ab-a9bc-fc71cc1fc823 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:48.934960 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-33d53d9e-32e8-46ab-a9bc-fc71cc1fc823 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:48.943084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-33d53d9e-32e8-46ab-a9bc-fc71cc1fc823 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1513 microversion: 2.1 time: 0.291026 Oct 27 14:11:48.943695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 353/736] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:48 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:48.952131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-530d657e-3243-485e-9edd-2ea37db83c19 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:48.953918 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-530d657e-3243-485e-9edd-2ea37db83c19 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:48.960264 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-530d657e-3243-485e-9edd-2ea37db83c19 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:48.960944 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-530d657e-3243-485e-9edd-2ea37db83c19 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:48.961912 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-530d657e-3243-485e-9edd-2ea37db83c19 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:48.962443 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-530d657e-3243-485e-9edd-2ea37db83c19 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:49.106963 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-530d657e-3243-485e-9edd-2ea37db83c19 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:49.115719 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-530d657e-3243-485e-9edd-2ea37db83c19 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1555 microversion: 2.1 time: 0.170985 Oct 27 14:11:49.117224 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 354/737] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:48 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:49.122747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0d5b8cc7-96af-4444-9e12-5aa7c92210a8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:49.124763 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0d5b8cc7-96af-4444-9e12-5aa7c92210a8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:49.131598 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d5b8cc7-96af-4444-9e12-5aa7c92210a8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:49.132190 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d5b8cc7-96af-4444-9e12-5aa7c92210a8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:49.132979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d5b8cc7-96af-4444-9e12-5aa7c92210a8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:49.133688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d5b8cc7-96af-4444-9e12-5aa7c92210a8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:49.284288 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0d5b8cc7-96af-4444-9e12-5aa7c92210a8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:49.291947 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0d5b8cc7-96af-4444-9e12-5aa7c92210a8 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.173903 Oct 27 14:11:49.292698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 355/738] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:49 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:49.382928 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-05fd2ce6-c287-4a6d-83c5-50a4859ee829 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:49.385127 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-05fd2ce6-c287-4a6d-83c5-50a4859ee829 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:49.403171 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-05fd2ce6-c287-4a6d-83c5-50a4859ee829 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:49.403722 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-05fd2ce6-c287-4a6d-83c5-50a4859ee829 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:49.405087 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-05fd2ce6-c287-4a6d-83c5-50a4859ee829 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:49.406237 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-05fd2ce6-c287-4a6d-83c5-50a4859ee829 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:49.581858 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-05fd2ce6-c287-4a6d-83c5-50a4859ee829 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:49.597090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-05fd2ce6-c287-4a6d-83c5-50a4859ee829 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:49.599102 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-05fd2ce6-c287-4a6d-83c5-50a4859ee829 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:49.600345 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-05fd2ce6-c287-4a6d-83c5-50a4859ee829 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1722 microversion: 2.20 time: 0.227134 Oct 27 14:11:49.601239 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 356/739] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:49 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:11:49.658439 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0d7451c4-1302-4538-ad7b-2f69f8efa293 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:49.659413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0d7451c4-1302-4538-ad7b-2f69f8efa293 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:49.671602 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d7451c4-1302-4538-ad7b-2f69f8efa293 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:49.672343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d7451c4-1302-4538-ad7b-2f69f8efa293 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:49.673313 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d7451c4-1302-4538-ad7b-2f69f8efa293 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:49.676600 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d7451c4-1302-4538-ad7b-2f69f8efa293 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:50.343958 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0d7451c4-1302-4538-ad7b-2f69f8efa293 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:50.362044 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0d7451c4-1302-4538-ad7b-2f69f8efa293 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.708015 Oct 27 14:11:50.362975 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 357/740] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:49 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:50.367536 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-beb49389-48ce-4582-a221-a39c90cab5d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:50.368134 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-beb49389-48ce-4582-a221-a39c90cab5d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:50.387431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-beb49389-48ce-4582-a221-a39c90cab5d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:50.388158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-beb49389-48ce-4582-a221-a39c90cab5d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:50.388671 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-beb49389-48ce-4582-a221-a39c90cab5d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:50.389179 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-beb49389-48ce-4582-a221-a39c90cab5d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:50.668279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-beb49389-48ce-4582-a221-a39c90cab5d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:50.678375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-beb49389-48ce-4582-a221-a39c90cab5d5 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1513 microversion: 2.1 time: 0.312574 Oct 27 14:11:50.679176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 358/741] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:50 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:50.695625 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6b50b2a6-35d1-42d3-9f9a-6cf6258b4cd3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:50.699630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6b50b2a6-35d1-42d3-9f9a-6cf6258b4cd3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:50.713231 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6b50b2a6-35d1-42d3-9f9a-6cf6258b4cd3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:50.719611 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6b50b2a6-35d1-42d3-9f9a-6cf6258b4cd3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:50.720494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6b50b2a6-35d1-42d3-9f9a-6cf6258b4cd3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:50.720931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6b50b2a6-35d1-42d3-9f9a-6cf6258b4cd3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:50.917562 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6b50b2a6-35d1-42d3-9f9a-6cf6258b4cd3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:50.932270 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6b50b2a6-35d1-42d3-9f9a-6cf6258b4cd3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1555 microversion: 2.1 time: 0.245334 Oct 27 14:11:50.933085 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 359/742] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:50 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:50.947601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-66fe24f0-e46a-42c3-8aed-43ac3805cda0 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:50.948492 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-66fe24f0-e46a-42c3-8aed-43ac3805cda0 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:50.962686 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66fe24f0-e46a-42c3-8aed-43ac3805cda0 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:50.963462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66fe24f0-e46a-42c3-8aed-43ac3805cda0 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:50.964412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66fe24f0-e46a-42c3-8aed-43ac3805cda0 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:50.964991 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66fe24f0-e46a-42c3-8aed-43ac3805cda0 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:51.355778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-66fe24f0-e46a-42c3-8aed-43ac3805cda0 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:51.363551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-66fe24f0-e46a-42c3-8aed-43ac3805cda0 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.427969 Oct 27 14:11:51.367319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 360/743] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:50 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:51.372106 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9e14836f-0d45-43f3-a56d-8f38b3204f00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:51.372998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9e14836f-0d45-43f3-a56d-8f38b3204f00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:51.380334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9e14836f-0d45-43f3-a56d-8f38b3204f00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:51.381139 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9e14836f-0d45-43f3-a56d-8f38b3204f00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:51.382163 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9e14836f-0d45-43f3-a56d-8f38b3204f00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:51.382816 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9e14836f-0d45-43f3-a56d-8f38b3204f00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:51.607475 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9e14836f-0d45-43f3-a56d-8f38b3204f00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:51.617832 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9e14836f-0d45-43f3-a56d-8f38b3204f00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:51.619478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9e14836f-0d45-43f3-a56d-8f38b3204f00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:51.620660 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9e14836f-0d45-43f3-a56d-8f38b3204f00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1722 microversion: 2.20 time: 0.252132 Oct 27 14:11:51.636140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 361/744] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:51 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:51.664173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fc4fe172-cad3-4e95-af9b-1ef1ce5827db tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:51.664786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fc4fe172-cad3-4e95-af9b-1ef1ce5827db tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:51.671460 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc4fe172-cad3-4e95-af9b-1ef1ce5827db tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:51.671964 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc4fe172-cad3-4e95-af9b-1ef1ce5827db tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:51.672758 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc4fe172-cad3-4e95-af9b-1ef1ce5827db tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:51.673192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc4fe172-cad3-4e95-af9b-1ef1ce5827db tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:52.222339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fc4fe172-cad3-4e95-af9b-1ef1ce5827db tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:52.252592 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fc4fe172-cad3-4e95-af9b-1ef1ce5827db tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.582873 Oct 27 14:11:52.254688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 362/745] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:51 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:52.267420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c571c4fb-a605-4bb4-922b-94edf619217f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:52.268888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c571c4fb-a605-4bb4-922b-94edf619217f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:52.278918 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c571c4fb-a605-4bb4-922b-94edf619217f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:52.282130 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c571c4fb-a605-4bb4-922b-94edf619217f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:52.283244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c571c4fb-a605-4bb4-922b-94edf619217f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:52.283845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c571c4fb-a605-4bb4-922b-94edf619217f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:52.555027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c571c4fb-a605-4bb4-922b-94edf619217f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:52.568539 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c571c4fb-a605-4bb4-922b-94edf619217f tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1513 microversion: 2.1 time: 0.312520 Oct 27 14:11:52.569393 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 363/746] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:52 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1513 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:52.574016 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3b0a230c-bfa5-4e7c-9441-1dd5f17820f5 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:52.574818 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3b0a230c-bfa5-4e7c-9441-1dd5f17820f5 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:52.583719 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3b0a230c-bfa5-4e7c-9441-1dd5f17820f5 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:52.584537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3b0a230c-bfa5-4e7c-9441-1dd5f17820f5 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:52.585823 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3b0a230c-bfa5-4e7c-9441-1dd5f17820f5 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:52.586414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3b0a230c-bfa5-4e7c-9441-1dd5f17820f5 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:52.777388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3b0a230c-bfa5-4e7c-9441-1dd5f17820f5 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:52.788729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3b0a230c-bfa5-4e7c-9441-1dd5f17820f5 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1555 microversion: 2.1 time: 0.218069 Oct 27 14:11:52.799862 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 364/747] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:52 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1555 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:52.805030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-745a5573-5455-494b-a7b2-1aa233574a8e tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:52.805885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-745a5573-5455-494b-a7b2-1aa233574a8e tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:52.814320 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-745a5573-5455-494b-a7b2-1aa233574a8e tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:52.816834 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-745a5573-5455-494b-a7b2-1aa233574a8e tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:52.817888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-745a5573-5455-494b-a7b2-1aa233574a8e tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:52.823206 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-745a5573-5455-494b-a7b2-1aa233574a8e tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:53.013621 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-745a5573-5455-494b-a7b2-1aa233574a8e tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:53.022293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-745a5573-5455-494b-a7b2-1aa233574a8e tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.221148 Oct 27 14:11:53.023407 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 365/748] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:52 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:53.028251 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1b72bd51-f70e-4ba9-b2b0-02c32be12cb1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:53.029163 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1b72bd51-f70e-4ba9-b2b0-02c32be12cb1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:53.036297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b72bd51-f70e-4ba9-b2b0-02c32be12cb1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:53.037276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b72bd51-f70e-4ba9-b2b0-02c32be12cb1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:53.038395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b72bd51-f70e-4ba9-b2b0-02c32be12cb1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:53.039157 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b72bd51-f70e-4ba9-b2b0-02c32be12cb1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:53.193880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1b72bd51-f70e-4ba9-b2b0-02c32be12cb1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:53.204991 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1b72bd51-f70e-4ba9-b2b0-02c32be12cb1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:53.207314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1b72bd51-f70e-4ba9-b2b0-02c32be12cb1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:53.208807 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1b72bd51-f70e-4ba9-b2b0-02c32be12cb1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1722 microversion: 2.20 time: 0.184150 Oct 27 14:11:53.209934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 366/749] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:53 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:53.270599 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d355a042-a4b9-4c14-85d3-adc64419ffdc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:53.271315 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d355a042-a4b9-4c14-85d3-adc64419ffdc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:53.277245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d355a042-a4b9-4c14-85d3-adc64419ffdc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:53.277636 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d355a042-a4b9-4c14-85d3-adc64419ffdc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:53.278410 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d355a042-a4b9-4c14-85d3-adc64419ffdc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:53.278842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d355a042-a4b9-4c14-85d3-adc64419ffdc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:53.477090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d355a042-a4b9-4c14-85d3-adc64419ffdc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:53.490022 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d355a042-a4b9-4c14-85d3-adc64419ffdc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.222902 Oct 27 14:11:53.496401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 367/750] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:53 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:53.585527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-298e20c3-95fe-464a-a26d-383e5ef53c92 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:53.586134 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-298e20c3-95fe-464a-a26d-383e5ef53c92 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:53.592168 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-298e20c3-95fe-464a-a26d-383e5ef53c92 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:53.592526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-298e20c3-95fe-464a-a26d-383e5ef53c92 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:53.593474 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-298e20c3-95fe-464a-a26d-383e5ef53c92 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:53.594066 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-298e20c3-95fe-464a-a26d-383e5ef53c92 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:53.763587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-298e20c3-95fe-464a-a26d-383e5ef53c92 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:53.773260 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-298e20c3-95fe-464a-a26d-383e5ef53c92 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1513 microversion: 2.1 time: 0.191344 Oct 27 14:11:53.773977 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 368/751] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:53 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:53.809175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-077dcb76-5bce-4fb7-8d2e-4798bef16fff tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:53.809863 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-077dcb76-5bce-4fb7-8d2e-4798bef16fff tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:53.817229 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077dcb76-5bce-4fb7-8d2e-4798bef16fff tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:53.817963 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077dcb76-5bce-4fb7-8d2e-4798bef16fff tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:53.818725 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077dcb76-5bce-4fb7-8d2e-4798bef16fff tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:53.819167 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-077dcb76-5bce-4fb7-8d2e-4798bef16fff tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:53.954097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-077dcb76-5bce-4fb7-8d2e-4798bef16fff tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:53.963477 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-077dcb76-5bce-4fb7-8d2e-4798bef16fff tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1555 microversion: 2.1 time: 0.158293 Oct 27 14:11:53.964076 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 369/752] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:53 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:54.041648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a459face-2030-471f-814a-7dc3a8a7a168 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:54.042537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a459face-2030-471f-814a-7dc3a8a7a168 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:54.050096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a459face-2030-471f-814a-7dc3a8a7a168 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:54.051595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a459face-2030-471f-814a-7dc3a8a7a168 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:54.051850 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a459face-2030-471f-814a-7dc3a8a7a168 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:54.052414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a459face-2030-471f-814a-7dc3a8a7a168 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:54.192561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a459face-2030-471f-814a-7dc3a8a7a168 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:54.203061 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a459face-2030-471f-814a-7dc3a8a7a168 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 0.164465 Oct 27 14:11:54.205537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 370/753] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:54 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:54.230912 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a8a427e9-3605-454e-8dd4-e2caf3da5a5d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:54.232603 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a8a427e9-3605-454e-8dd4-e2caf3da5a5d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:54.243799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a8a427e9-3605-454e-8dd4-e2caf3da5a5d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:54.244284 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a8a427e9-3605-454e-8dd4-e2caf3da5a5d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:54.245073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a8a427e9-3605-454e-8dd4-e2caf3da5a5d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:54.245507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a8a427e9-3605-454e-8dd4-e2caf3da5a5d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:54.473237 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a8a427e9-3605-454e-8dd4-e2caf3da5a5d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:54.482259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a8a427e9-3605-454e-8dd4-e2caf3da5a5d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:54.485117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a8a427e9-3605-454e-8dd4-e2caf3da5a5d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:54.486591 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a8a427e9-3605-454e-8dd4-e2caf3da5a5d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1722 microversion: 2.20 time: 0.262268 Oct 27 14:11:54.487196 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 371/754] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:54 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:54.511532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b2fbcb98-763f-4210-b691-54d464c9eff3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:54.512305 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b2fbcb98-763f-4210-b691-54d464c9eff3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:54.531683 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b2fbcb98-763f-4210-b691-54d464c9eff3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:54.532133 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b2fbcb98-763f-4210-b691-54d464c9eff3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:54.532922 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b2fbcb98-763f-4210-b691-54d464c9eff3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:54.533358 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b2fbcb98-763f-4210-b691-54d464c9eff3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:55.034773 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b2fbcb98-763f-4210-b691-54d464c9eff3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:55.057356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b2fbcb98-763f-4210-b691-54d464c9eff3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.551718 Oct 27 14:11:55.058233 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 372/755] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:54 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:11:55.067618 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e45ec71c-1d03-420e-823c-8484eae26bad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:55.068539 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e45ec71c-1d03-420e-823c-8484eae26bad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:55.076284 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e45ec71c-1d03-420e-823c-8484eae26bad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:55.076801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e45ec71c-1d03-420e-823c-8484eae26bad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:55.078435 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e45ec71c-1d03-420e-823c-8484eae26bad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:55.079462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e45ec71c-1d03-420e-823c-8484eae26bad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:55.434029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e45ec71c-1d03-420e-823c-8484eae26bad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:55.449929 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e45ec71c-1d03-420e-823c-8484eae26bad tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1513 microversion: 2.1 time: 0.388883 Oct 27 14:11:55.451336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 373/756] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:55 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:55.473670 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0266addc-b10b-4f84-b578-f6c16bd608de tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:55.474873 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0266addc-b10b-4f84-b578-f6c16bd608de tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:55.506516 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0266addc-b10b-4f84-b578-f6c16bd608de tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:55.507057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0266addc-b10b-4f84-b578-f6c16bd608de tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:55.507788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0266addc-b10b-4f84-b578-f6c16bd608de tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:55.512183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0266addc-b10b-4f84-b578-f6c16bd608de tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:56.160730 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0266addc-b10b-4f84-b578-f6c16bd608de tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:56.180509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0266addc-b10b-4f84-b578-f6c16bd608de tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1555 microversion: 2.1 time: 0.715933 Oct 27 14:11:56.182791 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 374/757] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:55 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1555 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:56.189563 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-72455192-7475-47c6-a111-133d8a0f9ebd tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:56.190778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-72455192-7475-47c6-a111-133d8a0f9ebd tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:56.203146 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-72455192-7475-47c6-a111-133d8a0f9ebd tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:56.203862 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-72455192-7475-47c6-a111-133d8a0f9ebd tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:56.204891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-72455192-7475-47c6-a111-133d8a0f9ebd tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:56.205543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-72455192-7475-47c6-a111-133d8a0f9ebd tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:57.616537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-72455192-7475-47c6-a111-133d8a0f9ebd tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:57.625170 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-72455192-7475-47c6-a111-133d8a0f9ebd tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1318 microversion: 2.1 time: 1.440398 Oct 27 14:11:57.632008 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 375/758] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:56 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1318 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:57.653874 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0b988045-9bef-4944-8480-f10a66daa5e7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:57.654792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0b988045-9bef-4944-8480-f10a66daa5e7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:57.663487 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b988045-9bef-4944-8480-f10a66daa5e7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:57.664327 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b988045-9bef-4944-8480-f10a66daa5e7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:57.665355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b988045-9bef-4944-8480-f10a66daa5e7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:57.666277 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b988045-9bef-4944-8480-f10a66daa5e7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:58.289306 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0b988045-9bef-4944-8480-f10a66daa5e7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:58.299439 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0b988045-9bef-4944-8480-f10a66daa5e7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:58.301113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0b988045-9bef-4944-8480-f10a66daa5e7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:58.302317 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0b988045-9bef-4944-8480-f10a66daa5e7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1665 microversion: 2.20 time: 0.660054 Oct 27 14:11:58.302897 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 376/759] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:11:57 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1665 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:11:58.317832 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8f417f19-b59d-4750-a5b5-5c9e0f5c88c9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:58.318386 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8f417f19-b59d-4750-a5b5-5c9e0f5c88c9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:58.336732 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f417f19-b59d-4750-a5b5-5c9e0f5c88c9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:58.337364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f417f19-b59d-4750-a5b5-5c9e0f5c88c9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:58.338305 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f417f19-b59d-4750-a5b5-5c9e0f5c88c9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:58.338969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f417f19-b59d-4750-a5b5-5c9e0f5c88c9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:58.595190 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8f417f19-b59d-4750-a5b5-5c9e0f5c88c9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:58.608509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8f417f19-b59d-4750-a5b5-5c9e0f5c88c9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.299768 Oct 27 14:11:58.610187 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 377/760] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:58 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:58.615261 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:58.616106 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:58.622598 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:58.625725 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:58.631420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:58.632270 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:58.676749 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:58.677526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:58.678172 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lazy-loading 'fault' on Instance uuid 1e098f1a-7a67-49aa-8612-ecf546da5a62 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:11:58.749010 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e59b470cb41474bb92d7e1049d02e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55431e3db544b7980c81c6303d1e8b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:58.774757 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-80ec3e64-fa1c-47fe-b315-97fc3d1f069e tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 200 len: 1307 microversion: 2.1 time: 0.150189 Oct 27 14:11:58.780560 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 378/761] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:58 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:58.787565 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-34ea6768-5201-4899-83ee-6c8a4218cb84 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:58.788552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-34ea6768-5201-4899-83ee-6c8a4218cb84 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:58.798961 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34ea6768-5201-4899-83ee-6c8a4218cb84 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:58.801032 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34ea6768-5201-4899-83ee-6c8a4218cb84 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:58.801984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34ea6768-5201-4899-83ee-6c8a4218cb84 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:58.803075 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34ea6768-5201-4899-83ee-6c8a4218cb84 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:59.094295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-34ea6768-5201-4899-83ee-6c8a4218cb84 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:59.109934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-34ea6768-5201-4899-83ee-6c8a4218cb84 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1555 microversion: 2.1 time: 0.323401 Oct 27 14:11:59.110596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 379/762] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:58 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1555 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:59.117464 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a41a73fa-1b88-46f0-901d-8d223af20805 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c55b207-608a-48b9-ae14-6c3ee3366f44"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:59.118969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a41a73fa-1b88-46f0-901d-8d223af20805 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:59.127537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a41a73fa-1b88-46f0-901d-8d223af20805 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:59.128057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a41a73fa-1b88-46f0-901d-8d223af20805 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:59.128922 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a41a73fa-1b88-46f0-901d-8d223af20805 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:59.129366 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a41a73fa-1b88-46f0-901d-8d223af20805 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:59.516111 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a41a73fa-1b88-46f0-901d-8d223af20805 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.404301 Oct 27 14:11:59.521381 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 380/763] 10.222.0.85 () {62 vars in 1363 bytes} [Wed Oct 27 14:11:59 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments => generated 188 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:11:59.524372 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-55805ff5-bb7c-4e04-b4de-3bf0b0d91e20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:11:59.524985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-55805ff5-bb7c-4e04-b4de-3bf0b0d91e20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:11:59.532507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-55805ff5-bb7c-4e04-b4de-3bf0b0d91e20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:59.533016 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-55805ff5-bb7c-4e04-b4de-3bf0b0d91e20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:59.533796 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-55805ff5-bb7c-4e04-b4de-3bf0b0d91e20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:11:59.534180 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-55805ff5-bb7c-4e04-b4de-3bf0b0d91e20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:11:59.672907 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-55805ff5-bb7c-4e04-b4de-3bf0b0d91e20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:11:59.680688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-55805ff5-bb7c-4e04-b4de-3bf0b0d91e20 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1506 microversion: 2.1 time: 0.162694 Oct 27 14:11:59.681271 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 381/764] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:11:59 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:11:59.866866 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-414ce155-7fed-4f3b-9afc-ad1de6f17e77 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Action: 'create', calling method: .version_select at 0x7f457063eb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-707784463"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:11:59.885310 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-414ce155-7fed-4f3b-9afc-ad1de6f17e77 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Getting quotas for project c924da1e65494809b6ceaf4b8a10e166. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:11:59.894913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-414ce155-7fed-4f3b-9afc-ad1de6f17e77 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Getting quotas for user 0e52a4ba12e74a0b828bb63d198516c3 and project c924da1e65494809b6ceaf4b8a10e166. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:11:59.992376 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-414ce155-7fed-4f3b-9afc-ad1de6f17e77 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Getting quotas for project c924da1e65494809b6ceaf4b8a10e166. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:11:59.996099 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-414ce155-7fed-4f3b-9afc-ad1de6f17e77 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Getting quotas for user 0e52a4ba12e74a0b828bb63d198516c3 and project c924da1e65494809b6ceaf4b8a10e166. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:12:00.009046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-414ce155-7fed-4f3b-9afc-ad1de6f17e77 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.326539 Oct 27 14:12:00.009658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 382/765] 10.222.0.85 () {60 vars in 1157 bytes} [Wed Oct 27 14:11:59 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:00.013941 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-29955222-af21-4263-845f-3fe947b8fd0f tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:00.014532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-29955222-af21-4263-845f-3fe947b8fd0f tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:00.021885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29955222-af21-4263-845f-3fe947b8fd0f tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:00.022335 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29955222-af21-4263-845f-3fe947b8fd0f tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:00.023109 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29955222-af21-4263-845f-3fe947b8fd0f tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:00.023570 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29955222-af21-4263-845f-3fe947b8fd0f tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:00.161356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-29955222-af21-4263-845f-3fe947b8fd0f tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:00.169355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-29955222-af21-4263-845f-3fe947b8fd0f tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.158632 Oct 27 14:12:00.169940 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 383/766] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:00 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:00.174888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6cbd1cb4-1e61-4a3e-af4b-eb97d93df2b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:12:00.176974 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6cbd1cb4-1e61-4a3e-af4b-eb97d93df2b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:00.186682 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6cbd1cb4-1e61-4a3e-af4b-eb97d93df2b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:00.187827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6cbd1cb4-1e61-4a3e-af4b-eb97d93df2b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:00.188827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6cbd1cb4-1e61-4a3e-af4b-eb97d93df2b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:00.189408 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6cbd1cb4-1e61-4a3e-af4b-eb97d93df2b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:00.287443 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6cbd1cb4-1e61-4a3e-af4b-eb97d93df2b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action" status: 202 len: 0 microversion: 2.20 time: 0.116415 Oct 27 14:12:00.288046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 384/767] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:12:00 2021] POST /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:12:00.297688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0de6ee6b-1982-45b5-8417-cebab4880e14 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dabddbf4-2c35-4fa5-a530-b2074a5c4d9f", "device": "/dev/sdb"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:12:00.299690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0de6ee6b-1982-45b5-8417-cebab4880e14 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:00.307368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0de6ee6b-1982-45b5-8417-cebab4880e14 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:00.307747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0de6ee6b-1982-45b5-8417-cebab4880e14 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:00.308555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0de6ee6b-1982-45b5-8417-cebab4880e14 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:00.311183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0de6ee6b-1982-45b5-8417-cebab4880e14 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:00.654977 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0de6ee6b-1982-45b5-8417-cebab4880e14 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "POST /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365532 Oct 27 14:12:00.657457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 385/768] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:12:00 2021] POST /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:00.689572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cf67209f-8210-413e-bad6-58afe5ec61c0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:00.693718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cf67209f-8210-413e-bad6-58afe5ec61c0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] [instance: 1e098f1a-7a67-49aa-8612-ecf546da5a62] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:00.702408 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf67209f-8210-413e-bad6-58afe5ec61c0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:00.704429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf67209f-8210-413e-bad6-58afe5ec61c0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:00.705505 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf67209f-8210-413e-bad6-58afe5ec61c0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:00.706863 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf67209f-8210-413e-bad6-58afe5ec61c0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:00.752750 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-cf67209f-8210-413e-bad6-58afe5ec61c0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] HTTP exception thrown: Instance 1e098f1a-7a67-49aa-8612-ecf546da5a62 could not be found. Oct 27 14:12:00.754103 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cf67209f-8210-413e-bad6-58afe5ec61c0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] Returning 404 to user: Instance 1e098f1a-7a67-49aa-8612-ecf546da5a62 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:12:00.756588 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cf67209f-8210-413e-bad6-58afe5ec61c0 tempest-AttachVolumeNegativeTest-734168662 tempest-AttachVolumeNegativeTest-734168662-project] 10.222.0.85 "GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62" status: 404 len: 111 microversion: 2.1 time: 0.097564 Oct 27 14:12:00.758213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 386/769] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:00 2021] GET /compute/v2.1/servers/1e098f1a-7a67-49aa-8612-ecf546da5a62 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:12:00.769932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6612a6be-041a-472c-98f8-20997e99e289 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:00.770554 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6612a6be-041a-472c-98f8-20997e99e289 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:00.789367 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6612a6be-041a-472c-98f8-20997e99e289 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:00.789834 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6612a6be-041a-472c-98f8-20997e99e289 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:00.790638 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6612a6be-041a-472c-98f8-20997e99e289 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:00.791075 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6612a6be-041a-472c-98f8-20997e99e289 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:01.124445 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6612a6be-041a-472c-98f8-20997e99e289 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:01.132555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6612a6be-041a-472c-98f8-20997e99e289 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1561 microversion: 2.1 time: 0.369848 Oct 27 14:12:01.143770 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 387/770] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:00 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1561 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:01.150200 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6905c0df-8007-4690-b3b9-74b49d31338e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:01.150882 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6905c0df-8007-4690-b3b9-74b49d31338e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:01.158990 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6905c0df-8007-4690-b3b9-74b49d31338e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:01.159498 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6905c0df-8007-4690-b3b9-74b49d31338e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:01.160294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6905c0df-8007-4690-b3b9-74b49d31338e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:01.160726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6905c0df-8007-4690-b3b9-74b49d31338e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:01.385915 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6905c0df-8007-4690-b3b9-74b49d31338e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:01.396791 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6905c0df-8007-4690-b3b9-74b49d31338e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:01.403319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6905c0df-8007-4690-b3b9-74b49d31338e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:01.407092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6905c0df-8007-4690-b3b9-74b49d31338e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1751 microversion: 2.20 time: 0.262204 Oct 27 14:12:01.408913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 388/771] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:01 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1751 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:01.423324 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-85a27262-04b3-46b8-8f93-59b603991926 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:01.424328 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-85a27262-04b3-46b8-8f93-59b603991926 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:01.436502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85a27262-04b3-46b8-8f93-59b603991926 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:01.439455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85a27262-04b3-46b8-8f93-59b603991926 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:01.440288 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85a27262-04b3-46b8-8f93-59b603991926 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:01.440726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85a27262-04b3-46b8-8f93-59b603991926 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:01.641076 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-85a27262-04b3-46b8-8f93-59b603991926 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:01.659602 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-85a27262-04b3-46b8-8f93-59b603991926 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.246804 Oct 27 14:12:01.660736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 389/772] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:01 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:01.666391 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-883a20bd-7c78-4085-9e36-3556bb7ebb26 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:01.667057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-883a20bd-7c78-4085-9e36-3556bb7ebb26 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:01.676635 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-883a20bd-7c78-4085-9e36-3556bb7ebb26 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:01.677286 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-883a20bd-7c78-4085-9e36-3556bb7ebb26 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:01.678227 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-883a20bd-7c78-4085-9e36-3556bb7ebb26 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:01.678815 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-883a20bd-7c78-4085-9e36-3556bb7ebb26 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:01.784376 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-883a20bd-7c78-4085-9e36-3556bb7ebb26 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lazy-loading 'services' on Instance uuid adbc567f-bc87-48cd-b910-ba46c84f914d {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:12:01.900379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-883a20bd-7c78-4085-9e36-3556bb7ebb26 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "DELETE /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments/61bb5062-3b9f-4d73-86f4-804c02cb5486" status: 202 len: 0 microversion: 2.1 time: 0.238166 Oct 27 14:12:01.901517 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 390/773] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:12:01 2021] DELETE /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments/61bb5062-3b9f-4d73-86f4-804c02cb5486 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:12:01.915731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c7fb86d6-8596-4c15-b7e8-04204588a841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:01.916845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c7fb86d6-8596-4c15-b7e8-04204588a841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:01.925717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c7fb86d6-8596-4c15-b7e8-04204588a841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:01.926378 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c7fb86d6-8596-4c15-b7e8-04204588a841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:01.927800 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c7fb86d6-8596-4c15-b7e8-04204588a841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:01.928693 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c7fb86d6-8596-4c15-b7e8-04204588a841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:01.975261 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c7fb86d6-8596-4c15-b7e8-04204588a841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068262 Oct 27 14:12:01.989299 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 391/774] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:01 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:02.427808 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-76332592-4d7c-475b-8d44-a91f8e18666d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:02.428561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-76332592-4d7c-475b-8d44-a91f8e18666d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:02.445168 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76332592-4d7c-475b-8d44-a91f8e18666d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:02.451053 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76332592-4d7c-475b-8d44-a91f8e18666d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:02.456499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76332592-4d7c-475b-8d44-a91f8e18666d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:02.457002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76332592-4d7c-475b-8d44-a91f8e18666d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:02.693816 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-76332592-4d7c-475b-8d44-a91f8e18666d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:02.706577 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-76332592-4d7c-475b-8d44-a91f8e18666d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:02.708115 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-76332592-4d7c-475b-8d44-a91f8e18666d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:02.709279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-76332592-4d7c-475b-8d44-a91f8e18666d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.285549 Oct 27 14:12:02.721680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 392/775] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:02 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:02.721680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f1ea1d0f-1e29-4577-99af-4cdb522bb666 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:02.721680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f1ea1d0f-1e29-4577-99af-4cdb522bb666 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:02.725212 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1ea1d0f-1e29-4577-99af-4cdb522bb666 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:02.725673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1ea1d0f-1e29-4577-99af-4cdb522bb666 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:02.726740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1ea1d0f-1e29-4577-99af-4cdb522bb666 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:02.727200 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1ea1d0f-1e29-4577-99af-4cdb522bb666 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:02.896377 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f1ea1d0f-1e29-4577-99af-4cdb522bb666 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:02.920670 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f1ea1d0f-1e29-4577-99af-4cdb522bb666 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.209471 Oct 27 14:12:02.921527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 393/776] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:02 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:03.018137 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c0209153-dcd3-4383-91e7-4c9301526cec tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:03.020184 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c0209153-dcd3-4383-91e7-4c9301526cec tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:03.044650 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0209153-dcd3-4383-91e7-4c9301526cec tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:03.045513 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0209153-dcd3-4383-91e7-4c9301526cec tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:03.047248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0209153-dcd3-4383-91e7-4c9301526cec tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:03.056062 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0209153-dcd3-4383-91e7-4c9301526cec tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:03.118241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c0209153-dcd3-4383-91e7-4c9301526cec tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129667 Oct 27 14:12:03.119596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 394/777] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:02 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:03.731282 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0d767ce2-7d01-4d99-b5ec-b42eddaeade6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:03.732339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0d767ce2-7d01-4d99-b5ec-b42eddaeade6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:03.740012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d767ce2-7d01-4d99-b5ec-b42eddaeade6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:03.740552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d767ce2-7d01-4d99-b5ec-b42eddaeade6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:03.741341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d767ce2-7d01-4d99-b5ec-b42eddaeade6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:03.741741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d767ce2-7d01-4d99-b5ec-b42eddaeade6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:03.916056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0d767ce2-7d01-4d99-b5ec-b42eddaeade6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:03.927096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0d767ce2-7d01-4d99-b5ec-b42eddaeade6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:03.929968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0d767ce2-7d01-4d99-b5ec-b42eddaeade6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:03.930279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0d767ce2-7d01-4d99-b5ec-b42eddaeade6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.205568 Oct 27 14:12:03.931457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 395/778] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:03 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:03.940391 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ebae98af-47ed-41d7-bc7a-001f0376ff79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:03.941092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ebae98af-47ed-41d7-bc7a-001f0376ff79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:03.947612 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ebae98af-47ed-41d7-bc7a-001f0376ff79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:03.948515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ebae98af-47ed-41d7-bc7a-001f0376ff79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:03.950001 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ebae98af-47ed-41d7-bc7a-001f0376ff79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:03.950644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ebae98af-47ed-41d7-bc7a-001f0376ff79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:04.094041 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ebae98af-47ed-41d7-bc7a-001f0376ff79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:04.101455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ebae98af-47ed-41d7-bc7a-001f0376ff79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.166263 Oct 27 14:12:04.103174 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 396/779] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:03 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:04.131841 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-62399cf0-da55-40ed-964a-459fc10c559f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:04.132805 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-62399cf0-da55-40ed-964a-459fc10c559f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:04.139799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-62399cf0-da55-40ed-964a-459fc10c559f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:04.141086 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-62399cf0-da55-40ed-964a-459fc10c559f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:04.141899 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-62399cf0-da55-40ed-964a-459fc10c559f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:04.142342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-62399cf0-da55-40ed-964a-459fc10c559f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:04.175656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-62399cf0-da55-40ed-964a-459fc10c559f tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048342 Oct 27 14:12:04.179173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 397/780] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:04 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:04.949760 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f4ec98f1-4fdd-43fb-b73d-5ad2ae294a87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:04.950463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f4ec98f1-4fdd-43fb-b73d-5ad2ae294a87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:04.957635 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4ec98f1-4fdd-43fb-b73d-5ad2ae294a87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:04.958082 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4ec98f1-4fdd-43fb-b73d-5ad2ae294a87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:04.958850 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4ec98f1-4fdd-43fb-b73d-5ad2ae294a87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:04.959318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4ec98f1-4fdd-43fb-b73d-5ad2ae294a87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:05.095234 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f4ec98f1-4fdd-43fb-b73d-5ad2ae294a87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:05.105164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f4ec98f1-4fdd-43fb-b73d-5ad2ae294a87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:05.106691 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f4ec98f1-4fdd-43fb-b73d-5ad2ae294a87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:05.108259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f4ec98f1-4fdd-43fb-b73d-5ad2ae294a87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.162229 Oct 27 14:12:05.109385 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 398/781] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:04 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:05.117736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bf7b5edd-4b72-4df6-a5aa-90ecdbbbf30a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:05.118619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-bf7b5edd-4b72-4df6-a5aa-90ecdbbbf30a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:05.126541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bf7b5edd-4b72-4df6-a5aa-90ecdbbbf30a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:05.127045 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bf7b5edd-4b72-4df6-a5aa-90ecdbbbf30a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:05.128066 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bf7b5edd-4b72-4df6-a5aa-90ecdbbbf30a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:05.128495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bf7b5edd-4b72-4df6-a5aa-90ecdbbbf30a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:05.255930 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bf7b5edd-4b72-4df6-a5aa-90ecdbbbf30a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:05.263451 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bf7b5edd-4b72-4df6-a5aa-90ecdbbbf30a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.149444 Oct 27 14:12:05.264051 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 399/782] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:05 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:05.268802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-51cc3c59-6109-4c2c-93cf-4f6a7e9779d6 req-8dfca80d-b9e6-40ed-9b15-ade38c7b1697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d115154-f737-44a1-83d0-3ed7b44ab9f5", "name": "network-vif-plugged", "status": "completed", "tag": "d7dbd7ad-d681-4b28-a600-73b66f728573"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:12:05.270437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:12:05.270437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:12:05.277065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-51cc3c59-6109-4c2c-93cf-4f6a7e9779d6 req-8dfca80d-b9e6-40ed-9b15-ade38c7b1697 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:05.277505 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-51cc3c59-6109-4c2c-93cf-4f6a7e9779d6 req-8dfca80d-b9e6-40ed-9b15-ade38c7b1697 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:05.288964 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-51cc3c59-6109-4c2c-93cf-4f6a7e9779d6 req-8dfca80d-b9e6-40ed-9b15-ade38c7b1697 service nova] Creating event network-vif-plugged:d7dbd7ad-d681-4b28-a600-73b66f728573 for instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 on hv-cinder-81566 Oct 27 14:12:05.293816 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-51cc3c59-6109-4c2c-93cf-4f6a7e9779d6 req-8dfca80d-b9e6-40ed-9b15-ade38c7b1697 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028680 Oct 27 14:12:05.294396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 400/783] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:12:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:05.299596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-17078994-8d45-4ebe-bef3-0832a8438ac8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:05.300567 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-17078994-8d45-4ebe-bef3-0832a8438ac8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:05.306473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-17078994-8d45-4ebe-bef3-0832a8438ac8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:05.306923 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-17078994-8d45-4ebe-bef3-0832a8438ac8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:05.307725 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-17078994-8d45-4ebe-bef3-0832a8438ac8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:05.308159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-17078994-8d45-4ebe-bef3-0832a8438ac8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:05.340138 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-17078994-8d45-4ebe-bef3-0832a8438ac8 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Oct 27 14:12:05.340712 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 401/784] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:05 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:06.127779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f93e0c10-e6ce-4523-90ee-f7815832461d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:06.128463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f93e0c10-e6ce-4523-90ee-f7815832461d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:06.135252 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f93e0c10-e6ce-4523-90ee-f7815832461d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:06.135879 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f93e0c10-e6ce-4523-90ee-f7815832461d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:06.136647 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f93e0c10-e6ce-4523-90ee-f7815832461d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:06.137083 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f93e0c10-e6ce-4523-90ee-f7815832461d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:06.259803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f93e0c10-e6ce-4523-90ee-f7815832461d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:06.268052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f93e0c10-e6ce-4523-90ee-f7815832461d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:06.269546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f93e0c10-e6ce-4523-90ee-f7815832461d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:06.270684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f93e0c10-e6ce-4523-90ee-f7815832461d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.147387 Oct 27 14:12:06.271262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 402/785] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:06 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:06.279996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f45fe675-1082-47c8-8f46-e602acdff200 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:06.280596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f45fe675-1082-47c8-8f46-e602acdff200 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:06.287112 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f45fe675-1082-47c8-8f46-e602acdff200 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:06.287524 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f45fe675-1082-47c8-8f46-e602acdff200 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:06.288284 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f45fe675-1082-47c8-8f46-e602acdff200 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:06.288714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f45fe675-1082-47c8-8f46-e602acdff200 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:06.411962 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f45fe675-1082-47c8-8f46-e602acdff200 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:06.420085 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f45fe675-1082-47c8-8f46-e602acdff200 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.143167 Oct 27 14:12:06.421241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 403/786] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:06 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:06.426746 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9d1fdcac-3ab1-49d6-9482-60b6ed3666f2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:06.427684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9d1fdcac-3ab1-49d6-9482-60b6ed3666f2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:06.433872 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9d1fdcac-3ab1-49d6-9482-60b6ed3666f2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:06.434321 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9d1fdcac-3ab1-49d6-9482-60b6ed3666f2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:06.435094 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9d1fdcac-3ab1-49d6-9482-60b6ed3666f2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:06.435610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9d1fdcac-3ab1-49d6-9482-60b6ed3666f2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:06.469402 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9d1fdcac-3ab1-49d6-9482-60b6ed3666f2 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045478 Oct 27 14:12:06.469968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 404/787] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:06 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:07.289547 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-94b713c0-b8f2-4751-91b9-64e9d2129d0d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:07.290235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-94b713c0-b8f2-4751-91b9-64e9d2129d0d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:07.296479 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94b713c0-b8f2-4751-91b9-64e9d2129d0d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:07.298140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94b713c0-b8f2-4751-91b9-64e9d2129d0d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:07.299306 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94b713c0-b8f2-4751-91b9-64e9d2129d0d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:07.299745 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94b713c0-b8f2-4751-91b9-64e9d2129d0d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:07.446616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-94b713c0-b8f2-4751-91b9-64e9d2129d0d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:07.456523 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-94b713c0-b8f2-4751-91b9-64e9d2129d0d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:07.458820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-94b713c0-b8f2-4751-91b9-64e9d2129d0d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:07.460273 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-94b713c0-b8f2-4751-91b9-64e9d2129d0d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.174322 Oct 27 14:12:07.461334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 405/788] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:07 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:07.476665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-368e4172-16b3-47fb-884d-edb44108b6df tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:07.477170 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-368e4172-16b3-47fb-884d-edb44108b6df tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:07.483817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-368e4172-16b3-47fb-884d-edb44108b6df tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:07.485648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-368e4172-16b3-47fb-884d-edb44108b6df tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:07.486672 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-368e4172-16b3-47fb-884d-edb44108b6df tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:07.487113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-368e4172-16b3-47fb-884d-edb44108b6df tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:07.634698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-368e4172-16b3-47fb-884d-edb44108b6df tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:07.642954 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-368e4172-16b3-47fb-884d-edb44108b6df tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1359 microversion: 2.1 time: 0.180509 Oct 27 14:12:07.647919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 406/789] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:07 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:07.648244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-940e3216-7978-49ac-813d-d429428e4679 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:07.649155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-940e3216-7978-49ac-813d-d429428e4679 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:07.655107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-940e3216-7978-49ac-813d-d429428e4679 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:07.655595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-940e3216-7978-49ac-813d-d429428e4679 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:07.656425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-940e3216-7978-49ac-813d-d429428e4679 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:07.657369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-940e3216-7978-49ac-813d-d429428e4679 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:07.686690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-940e3216-7978-49ac-813d-d429428e4679 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042084 Oct 27 14:12:07.687280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 407/790] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:07 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:08.478640 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e845b2e8-6f14-4be6-abfe-0b3d9cad649c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:08.479365 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e845b2e8-6f14-4be6-abfe-0b3d9cad649c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:08.486246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e845b2e8-6f14-4be6-abfe-0b3d9cad649c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:08.486674 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e845b2e8-6f14-4be6-abfe-0b3d9cad649c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:08.487459 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e845b2e8-6f14-4be6-abfe-0b3d9cad649c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:08.487886 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e845b2e8-6f14-4be6-abfe-0b3d9cad649c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:08.608395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e845b2e8-6f14-4be6-abfe-0b3d9cad649c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:08.617934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e845b2e8-6f14-4be6-abfe-0b3d9cad649c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:08.619461 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e845b2e8-6f14-4be6-abfe-0b3d9cad649c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:08.620617 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e845b2e8-6f14-4be6-abfe-0b3d9cad649c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.145677 Oct 27 14:12:08.621173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 408/791] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:08 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:08.660310 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-116cb0a9-c7a1-42d6-8fbc-88cae08955a9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:08.660921 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-116cb0a9-c7a1-42d6-8fbc-88cae08955a9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:08.666930 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-116cb0a9-c7a1-42d6-8fbc-88cae08955a9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:08.667424 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-116cb0a9-c7a1-42d6-8fbc-88cae08955a9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:08.668182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-116cb0a9-c7a1-42d6-8fbc-88cae08955a9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:08.668639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-116cb0a9-c7a1-42d6-8fbc-88cae08955a9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:08.797576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-116cb0a9-c7a1-42d6-8fbc-88cae08955a9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:08.805002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-116cb0a9-c7a1-42d6-8fbc-88cae08955a9 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1549 microversion: 2.1 time: 0.148860 Oct 27 14:12:08.805589 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 409/792] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:08 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:08.811356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8c0f3bec-1db0-467d-b06e-14301445bf8a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:08.812264 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8c0f3bec-1db0-467d-b06e-14301445bf8a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:08.818370 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c0f3bec-1db0-467d-b06e-14301445bf8a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:08.818758 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c0f3bec-1db0-467d-b06e-14301445bf8a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:08.819747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c0f3bec-1db0-467d-b06e-14301445bf8a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:08.820182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c0f3bec-1db0-467d-b06e-14301445bf8a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:08.852362 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8c0f3bec-1db0-467d-b06e-14301445bf8a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044514 Oct 27 14:12:08.852989 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 410/793] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:08 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:08.857153 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8be94a19-7130-48ba-b859-5a89a1d2a336 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:08.857750 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8be94a19-7130-48ba-b859-5a89a1d2a336 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:08.863648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8be94a19-7130-48ba-b859-5a89a1d2a336 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:08.864097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8be94a19-7130-48ba-b859-5a89a1d2a336 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:08.864860 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8be94a19-7130-48ba-b859-5a89a1d2a336 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:08.865295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8be94a19-7130-48ba-b859-5a89a1d2a336 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:08.986320 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8be94a19-7130-48ba-b859-5a89a1d2a336 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:08.993784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8be94a19-7130-48ba-b859-5a89a1d2a336 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1549 microversion: 2.1 time: 0.139862 Oct 27 14:12:08.994352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 411/794] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:08 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1549 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:09.008993 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f7ad431c-eb79-432f-85c9-15d10a6c1a00 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:09.012559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:12:09.012559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:12:09.013547 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f7ad431c-eb79-432f-85c9-15d10a6c1a00 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:09.014220 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f7ad431c-eb79-432f-85c9-15d10a6c1a00 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Searching by: {'deleted': False, 'project_id': '9fb32c18000f440e88bc81eec30692b9'} {{(pid=115931) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 27 14:12:09.022150 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f7ad431c-eb79-432f-85c9-15d10a6c1a00 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:09.022595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f7ad431c-eb79-432f-85c9-15d10a6c1a00 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:09.023431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f7ad431c-eb79-432f-85c9-15d10a6c1a00 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:09.023869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f7ad431c-eb79-432f-85c9-15d10a6c1a00 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:09.117557 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.multi_cell_list [None req-f7ad431c-eb79-432f-85c9-15d10a6c1a00 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115931) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 27 14:12:09.215577 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f7ad431c-eb79-432f-85c9-15d10a6c1a00 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209897 Oct 27 14:12:09.216214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 412/795] 10.222.0.85 () {58 vars in 1124 bytes} [Wed Oct 27 14:12:09 2021] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:12:09.231310 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e7daa231-6c21-4647-b1ca-2c211c7f9b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:09.231310 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e7daa231-6c21-4647-b1ca-2c211c7f9b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:09.235773 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e7daa231-6c21-4647-b1ca-2c211c7f9b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:09.236222 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e7daa231-6c21-4647-b1ca-2c211c7f9b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:09.237013 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e7daa231-6c21-4647-b1ca-2c211c7f9b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:09.237459 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e7daa231-6c21-4647-b1ca-2c211c7f9b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:09.360304 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e7daa231-6c21-4647-b1ca-2c211c7f9b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:09.367651 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e7daa231-6c21-4647-b1ca-2c211c7f9b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1549 microversion: 2.1 time: 0.143781 Oct 27 14:12:09.368147 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 413/796] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:09 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1549 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:09.639713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d719b95d-18d0-4130-98d4-08f7d26e1a00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:09.640340 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d719b95d-18d0-4130-98d4-08f7d26e1a00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:09.653484 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d719b95d-18d0-4130-98d4-08f7d26e1a00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:09.653991 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d719b95d-18d0-4130-98d4-08f7d26e1a00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:09.654887 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d719b95d-18d0-4130-98d4-08f7d26e1a00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:09.655486 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d719b95d-18d0-4130-98d4-08f7d26e1a00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:09.785342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d719b95d-18d0-4130-98d4-08f7d26e1a00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:09.793618 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d719b95d-18d0-4130-98d4-08f7d26e1a00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:09.795162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d719b95d-18d0-4130-98d4-08f7d26e1a00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:09.796309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d719b95d-18d0-4130-98d4-08f7d26e1a00 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.160640 Oct 27 14:12:09.796876 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 414/797] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:09 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:09.863125 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6a36fc21-13c6-4e4e-a632-1f53950b01eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:09.864055 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6a36fc21-13c6-4e4e-a632-1f53950b01eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:09.870010 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6a36fc21-13c6-4e4e-a632-1f53950b01eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:09.870456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6a36fc21-13c6-4e4e-a632-1f53950b01eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:09.871257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6a36fc21-13c6-4e4e-a632-1f53950b01eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:09.871690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6a36fc21-13c6-4e4e-a632-1f53950b01eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:09.904197 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6a36fc21-13c6-4e4e-a632-1f53950b01eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Oct 27 14:12:09.904766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 415/798] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:09 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:12:10.814530 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-159c242c-d5ac-40f9-ad3b-fd8dd2f5e19b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:10.815180 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-159c242c-d5ac-40f9-ad3b-fd8dd2f5e19b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:10.821389 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-159c242c-d5ac-40f9-ad3b-fd8dd2f5e19b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:10.821833 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-159c242c-d5ac-40f9-ad3b-fd8dd2f5e19b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:10.822621 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-159c242c-d5ac-40f9-ad3b-fd8dd2f5e19b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:10.823048 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-159c242c-d5ac-40f9-ad3b-fd8dd2f5e19b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:10.945920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-159c242c-d5ac-40f9-ad3b-fd8dd2f5e19b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:10.954690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-159c242c-d5ac-40f9-ad3b-fd8dd2f5e19b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:10.956209 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-159c242c-d5ac-40f9-ad3b-fd8dd2f5e19b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:10.957364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-159c242c-d5ac-40f9-ad3b-fd8dd2f5e19b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.146563 Oct 27 14:12:10.957903 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 416/799] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:10 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:10.965720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5b6b2577-104b-4ea9-823a-d58640d704eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:10.966614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5b6b2577-104b-4ea9-823a-d58640d704eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:10.973120 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b6b2577-104b-4ea9-823a-d58640d704eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:10.973922 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b6b2577-104b-4ea9-823a-d58640d704eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:10.975033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b6b2577-104b-4ea9-823a-d58640d704eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:10.975498 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5b6b2577-104b-4ea9-823a-d58640d704eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:11.006999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5b6b2577-104b-4ea9-823a-d58640d704eb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047884 Oct 27 14:12:11.007605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 417/800] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:10 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:11.975506 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e0c8cd2b-d897-4b41-a2dc-5702f1be3b7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:11.976247 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e0c8cd2b-d897-4b41-a2dc-5702f1be3b7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:11.982275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0c8cd2b-d897-4b41-a2dc-5702f1be3b7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:11.982719 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0c8cd2b-d897-4b41-a2dc-5702f1be3b7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:11.983519 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0c8cd2b-d897-4b41-a2dc-5702f1be3b7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:11.983947 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0c8cd2b-d897-4b41-a2dc-5702f1be3b7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:12.108329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e0c8cd2b-d897-4b41-a2dc-5702f1be3b7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:12.117226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e0c8cd2b-d897-4b41-a2dc-5702f1be3b7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:12.118696 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e0c8cd2b-d897-4b41-a2dc-5702f1be3b7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:12.119870 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e0c8cd2b-d897-4b41-a2dc-5702f1be3b7c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.148003 Oct 27 14:12:12.120426 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 418/801] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:11 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:12.124743 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f0203dec-e52c-4651-a19d-a2c69f244841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:12.125761 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f0203dec-e52c-4651-a19d-a2c69f244841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:12.131709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0203dec-e52c-4651-a19d-a2c69f244841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:12.132495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0203dec-e52c-4651-a19d-a2c69f244841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:12.133322 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0203dec-e52c-4651-a19d-a2c69f244841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:12.133752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0203dec-e52c-4651-a19d-a2c69f244841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:12.162794 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f0203dec-e52c-4651-a19d-a2c69f244841 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041373 Oct 27 14:12:12.163368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 419/802] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:12 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:13.137361 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-684ef204-1cf0-4f18-86a1-fd06535ddf87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:13.137985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-684ef204-1cf0-4f18-86a1-fd06535ddf87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:13.144831 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-684ef204-1cf0-4f18-86a1-fd06535ddf87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:13.145280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-684ef204-1cf0-4f18-86a1-fd06535ddf87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:13.146069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-684ef204-1cf0-4f18-86a1-fd06535ddf87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:13.146484 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-684ef204-1cf0-4f18-86a1-fd06535ddf87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:13.273553 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-684ef204-1cf0-4f18-86a1-fd06535ddf87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:13.283857 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-684ef204-1cf0-4f18-86a1-fd06535ddf87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:13.285379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-684ef204-1cf0-4f18-86a1-fd06535ddf87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:13.286596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-684ef204-1cf0-4f18-86a1-fd06535ddf87 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.153098 Oct 27 14:12:13.287186 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 420/803] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:13 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:13.291543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c12348e7-3afa-4680-9494-cbd76c7ebd01 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:13.292437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c12348e7-3afa-4680-9494-cbd76c7ebd01 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:13.298727 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c12348e7-3afa-4680-9494-cbd76c7ebd01 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:13.299203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c12348e7-3afa-4680-9494-cbd76c7ebd01 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:13.299972 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c12348e7-3afa-4680-9494-cbd76c7ebd01 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:13.300405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c12348e7-3afa-4680-9494-cbd76c7ebd01 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:13.338626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c12348e7-3afa-4680-9494-cbd76c7ebd01 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050370 Oct 27 14:12:13.339207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 421/804] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:13 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:14.304636 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-18956c3b-683f-4720-93f6-958c1a71f8e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:14.305194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-18956c3b-683f-4720-93f6-958c1a71f8e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:14.311455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18956c3b-683f-4720-93f6-958c1a71f8e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:14.311897 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18956c3b-683f-4720-93f6-958c1a71f8e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:14.312656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18956c3b-683f-4720-93f6-958c1a71f8e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:14.313587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18956c3b-683f-4720-93f6-958c1a71f8e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:14.440309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-18956c3b-683f-4720-93f6-958c1a71f8e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:14.448606 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-18956c3b-683f-4720-93f6-958c1a71f8e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:14.450026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-18956c3b-683f-4720-93f6-958c1a71f8e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:14.451182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-18956c3b-683f-4720-93f6-958c1a71f8e5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.150396 Oct 27 14:12:14.451734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 422/805] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:14 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:14.456769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1173714e-beba-4d54-9892-18dc48318ae1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:14.457871 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1173714e-beba-4d54-9892-18dc48318ae1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:14.463926 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1173714e-beba-4d54-9892-18dc48318ae1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:14.464374 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1173714e-beba-4d54-9892-18dc48318ae1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:14.465141 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1173714e-beba-4d54-9892-18dc48318ae1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:14.465566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1173714e-beba-4d54-9892-18dc48318ae1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:14.496559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1173714e-beba-4d54-9892-18dc48318ae1 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043753 Oct 27 14:12:14.497207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 423/806] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:14 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:15.470241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-64fc3d90-fff0-4259-9f4c-3d81c294fbab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:15.470998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-64fc3d90-fff0-4259-9f4c-3d81c294fbab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:15.477778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-64fc3d90-fff0-4259-9f4c-3d81c294fbab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:15.478218 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-64fc3d90-fff0-4259-9f4c-3d81c294fbab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:15.479000 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-64fc3d90-fff0-4259-9f4c-3d81c294fbab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:15.479475 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-64fc3d90-fff0-4259-9f4c-3d81c294fbab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:15.615890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-64fc3d90-fff0-4259-9f4c-3d81c294fbab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:15.626497 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-64fc3d90-fff0-4259-9f4c-3d81c294fbab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:15.628078 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-64fc3d90-fff0-4259-9f4c-3d81c294fbab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:15.629682 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-64fc3d90-fff0-4259-9f4c-3d81c294fbab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.163316 Oct 27 14:12:15.630250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 424/807] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:15 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:15.650879 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9b82003e-59b8-456e-b7d3-8243af9e0627 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:15.651507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9b82003e-59b8-456e-b7d3-8243af9e0627 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:15.658209 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b82003e-59b8-456e-b7d3-8243af9e0627 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:15.658721 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b82003e-59b8-456e-b7d3-8243af9e0627 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:15.659551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b82003e-59b8-456e-b7d3-8243af9e0627 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:15.659974 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b82003e-59b8-456e-b7d3-8243af9e0627 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:15.691618 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9b82003e-59b8-456e-b7d3-8243af9e0627 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Oct 27 14:12:15.692207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 425/808] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:15 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:16.121674 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-758b7b1b-262e-4a5e-8c2e-d53f35664f45 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00363ed4-575a-4cfb-aeb5-2318e1b8b8c9"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:12:16.122803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-758b7b1b-262e-4a5e-8c2e-d53f35664f45 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:16.129795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-758b7b1b-262e-4a5e-8c2e-d53f35664f45 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:16.130239 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-758b7b1b-262e-4a5e-8c2e-d53f35664f45 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:16.131050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-758b7b1b-262e-4a5e-8c2e-d53f35664f45 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:16.131526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-758b7b1b-262e-4a5e-8c2e-d53f35664f45 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:19.072294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-758b7b1b-262e-4a5e-8c2e-d53f35664f45 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "POST /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.954592 Oct 27 14:12:19.072996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 426/809] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:12:16 2021] POST /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/os-volume_attachments => generated 194 bytes in 2956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:12:19.077827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9ae119e5-f87e-4997-947d-5f6ac9dfdaaa tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:19.078514 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9ae119e5-f87e-4997-947d-5f6ac9dfdaaa tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:19.085282 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9ae119e5-f87e-4997-947d-5f6ac9dfdaaa tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:19.085726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9ae119e5-f87e-4997-947d-5f6ac9dfdaaa tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:19.086499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9ae119e5-f87e-4997-947d-5f6ac9dfdaaa tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:19.086932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9ae119e5-f87e-4997-947d-5f6ac9dfdaaa tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:19.224555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9ae119e5-f87e-4997-947d-5f6ac9dfdaaa tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:19.232774 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9ae119e5-f87e-4997-947d-5f6ac9dfdaaa tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:19.234225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9ae119e5-f87e-4997-947d-5f6ac9dfdaaa tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:19.235415 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9ae119e5-f87e-4997-947d-5f6ac9dfdaaa tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1753 microversion: 2.20 time: 0.161361 Oct 27 14:12:19.236481 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 427/810] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:19 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:19.241085 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c05b589d-c51b-466e-8b00-17471e4779d3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:19.241935 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c05b589d-c51b-466e-8b00-17471e4779d3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:19.248272 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c05b589d-c51b-466e-8b00-17471e4779d3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:19.248723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c05b589d-c51b-466e-8b00-17471e4779d3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:19.249501 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c05b589d-c51b-466e-8b00-17471e4779d3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:19.249936 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c05b589d-c51b-466e-8b00-17471e4779d3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:19.279364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c05b589d-c51b-466e-8b00-17471e4779d3 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041797 Oct 27 14:12:19.279911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 428/811] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:19 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:20.256150 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0ef08b28-b4b9-4872-a50a-e0d18fb07afe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:20.256824 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0ef08b28-b4b9-4872-a50a-e0d18fb07afe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:20.263259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ef08b28-b4b9-4872-a50a-e0d18fb07afe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:20.263708 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ef08b28-b4b9-4872-a50a-e0d18fb07afe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:20.264671 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ef08b28-b4b9-4872-a50a-e0d18fb07afe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:20.265007 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ef08b28-b4b9-4872-a50a-e0d18fb07afe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:20.460738 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ef08b28-b4b9-4872-a50a-e0d18fb07afe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:20.468952 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ef08b28-b4b9-4872-a50a-e0d18fb07afe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:20.470446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ef08b28-b4b9-4872-a50a-e0d18fb07afe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:20.471729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0ef08b28-b4b9-4872-a50a-e0d18fb07afe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.219923 Oct 27 14:12:20.472292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 429/812] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:20 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:20.476624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e9a7eb15-4931-4c6a-99e3-545d5bc5aa27 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:20.477734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e9a7eb15-4931-4c6a-99e3-545d5bc5aa27 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:20.483626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e9a7eb15-4931-4c6a-99e3-545d5bc5aa27 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:20.484069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e9a7eb15-4931-4c6a-99e3-545d5bc5aa27 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:20.484826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e9a7eb15-4931-4c6a-99e3-545d5bc5aa27 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:20.485249 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e9a7eb15-4931-4c6a-99e3-545d5bc5aa27 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:20.516096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e9a7eb15-4931-4c6a-99e3-545d5bc5aa27 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042771 Oct 27 14:12:20.516667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 430/813] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:20 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:21.491256 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-37ca1bf8-9658-457c-ba1d-e715578bd87f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:21.491965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-37ca1bf8-9658-457c-ba1d-e715578bd87f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:21.498285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-37ca1bf8-9658-457c-ba1d-e715578bd87f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:21.498828 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-37ca1bf8-9658-457c-ba1d-e715578bd87f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:21.499655 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-37ca1bf8-9658-457c-ba1d-e715578bd87f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:21.500074 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-37ca1bf8-9658-457c-ba1d-e715578bd87f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:21.706276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-37ca1bf8-9658-457c-ba1d-e715578bd87f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:21.722691 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-37ca1bf8-9658-457c-ba1d-e715578bd87f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:21.730673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-37ca1bf8-9658-457c-ba1d-e715578bd87f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:21.730673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-37ca1bf8-9658-457c-ba1d-e715578bd87f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.237681 Oct 27 14:12:21.730673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 431/814] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:21 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:21.730673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fc381c09-868e-4f2a-b71b-cc802ac93f1d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:21.731434 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fc381c09-868e-4f2a-b71b-cc802ac93f1d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:21.737823 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc381c09-868e-4f2a-b71b-cc802ac93f1d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:21.738277 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc381c09-868e-4f2a-b71b-cc802ac93f1d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:21.739387 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc381c09-868e-4f2a-b71b-cc802ac93f1d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:21.739987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc381c09-868e-4f2a-b71b-cc802ac93f1d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:21.772019 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fc381c09-868e-4f2a-b71b-cc802ac93f1d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045353 Oct 27 14:12:21.772650 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 432/815] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:12:21 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:12:22.744082 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d1cbf3f3-2607-4277-ac10-5416486fc062 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:22.745136 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d1cbf3f3-2607-4277-ac10-5416486fc062 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:22.755030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d1cbf3f3-2607-4277-ac10-5416486fc062 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:22.755793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d1cbf3f3-2607-4277-ac10-5416486fc062 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:22.756790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d1cbf3f3-2607-4277-ac10-5416486fc062 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:22.757372 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d1cbf3f3-2607-4277-ac10-5416486fc062 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:22.894494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d1cbf3f3-2607-4277-ac10-5416486fc062 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:22.905749 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d1cbf3f3-2607-4277-ac10-5416486fc062 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:22.906063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d1cbf3f3-2607-4277-ac10-5416486fc062 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:22.907244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d1cbf3f3-2607-4277-ac10-5416486fc062 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.168035 Oct 27 14:12:22.907840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 433/816] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:22 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:23.202899 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-363bad01-c78f-4ee4-8c76-4ed8ad631541 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:23.203415 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-363bad01-c78f-4ee4-8c76-4ed8ad631541 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:23.211250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-363bad01-c78f-4ee4-8c76-4ed8ad631541 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:23.212813 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-363bad01-c78f-4ee4-8c76-4ed8ad631541 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:23.213623 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-363bad01-c78f-4ee4-8c76-4ed8ad631541 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:23.214060 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-363bad01-c78f-4ee4-8c76-4ed8ad631541 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:23.489305 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-363bad01-c78f-4ee4-8c76-4ed8ad631541 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lazy-loading 'services' on Instance uuid f40bbdf7-2daa-4c43-bb64-5d7e74d23348 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:12:23.575095 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-363bad01-c78f-4ee4-8c76-4ed8ad631541 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348/os-volume_attachments/dabddbf4-2c35-4fa5-a530-b2074a5c4d9f" status: 202 len: 0 microversion: 2.1 time: 0.375711 Oct 27 14:12:23.576262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 434/817] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:12:23 2021] DELETE /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348/os-volume_attachments/dabddbf4-2c35-4fa5-a530-b2074a5c4d9f => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:12:23.927197 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4f104c77-90e5-47b4-a851-ce22ddc9f745 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:23.927931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4f104c77-90e5-47b4-a851-ce22ddc9f745 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:23.934260 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f104c77-90e5-47b4-a851-ce22ddc9f745 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:23.934951 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f104c77-90e5-47b4-a851-ce22ddc9f745 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:23.935943 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f104c77-90e5-47b4-a851-ce22ddc9f745 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:23.936531 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f104c77-90e5-47b4-a851-ce22ddc9f745 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:24.148532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4f104c77-90e5-47b4-a851-ce22ddc9f745 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:24.157497 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4f104c77-90e5-47b4-a851-ce22ddc9f745 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:24.159559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4f104c77-90e5-47b4-a851-ce22ddc9f745 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:24.160720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4f104c77-90e5-47b4-a851-ce22ddc9f745 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.238509 Oct 27 14:12:24.161453 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 435/818] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:23 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:24.165902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5697fc76-cd50-4087-bdc9-fcb2a0b9149c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:24.166596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5697fc76-cd50-4087-bdc9-fcb2a0b9149c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:24.177318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5697fc76-cd50-4087-bdc9-fcb2a0b9149c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:24.178194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5697fc76-cd50-4087-bdc9-fcb2a0b9149c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:24.179230 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5697fc76-cd50-4087-bdc9-fcb2a0b9149c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:24.179840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5697fc76-cd50-4087-bdc9-fcb2a0b9149c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:24.211700 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5697fc76-cd50-4087-bdc9-fcb2a0b9149c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:12:24.316338 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5697fc76-cd50-4087-bdc9-fcb2a0b9149c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "DELETE /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 204 len: 0 microversion: 2.1 time: 0.153347 Oct 27 14:12:24.317117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 436/819] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:12:24 2021] DELETE /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:12:24.326804 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-66b7fb52-c575-46d4-a008-4bcaeb73d57c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:24.327523 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-66b7fb52-c575-46d4-a008-4bcaeb73d57c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:24.333861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66b7fb52-c575-46d4-a008-4bcaeb73d57c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:24.334295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66b7fb52-c575-46d4-a008-4bcaeb73d57c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:24.335066 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66b7fb52-c575-46d4-a008-4bcaeb73d57c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:24.335521 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-66b7fb52-c575-46d4-a008-4bcaeb73d57c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:24.515932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-66b7fb52-c575-46d4-a008-4bcaeb73d57c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:24.525280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-66b7fb52-c575-46d4-a008-4bcaeb73d57c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.203146 Oct 27 14:12:24.525855 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 437/820] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:24 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:25.178200 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9a88192d-620e-48ab-abdb-ee6f06ee120b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:25.178864 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9a88192d-620e-48ab-abdb-ee6f06ee120b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:25.188917 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a88192d-620e-48ab-abdb-ee6f06ee120b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:25.189344 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a88192d-620e-48ab-abdb-ee6f06ee120b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:25.190144 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a88192d-620e-48ab-abdb-ee6f06ee120b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:25.190632 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a88192d-620e-48ab-abdb-ee6f06ee120b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:25.327524 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9a88192d-620e-48ab-abdb-ee6f06ee120b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:25.337538 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9a88192d-620e-48ab-abdb-ee6f06ee120b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:25.339244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9a88192d-620e-48ab-abdb-ee6f06ee120b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:25.340806 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9a88192d-620e-48ab-abdb-ee6f06ee120b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.166171 Oct 27 14:12:25.341458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 438/821] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:25 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:25.542532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3f3ab63c-72d7-4380-a7b5-459680875f91 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:25.543169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3f3ab63c-72d7-4380-a7b5-459680875f91 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:25.553420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f3ab63c-72d7-4380-a7b5-459680875f91 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:25.554158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f3ab63c-72d7-4380-a7b5-459680875f91 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:25.555177 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f3ab63c-72d7-4380-a7b5-459680875f91 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:25.555689 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f3ab63c-72d7-4380-a7b5-459680875f91 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:25.700534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3f3ab63c-72d7-4380-a7b5-459680875f91 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:25.708955 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3f3ab63c-72d7-4380-a7b5-459680875f91 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.170287 Oct 27 14:12:25.709516 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 439/822] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:25 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:26.359253 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e5c571af-6320-4726-af9f-05c26a685964 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:26.360033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e5c571af-6320-4726-af9f-05c26a685964 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:26.369456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5c571af-6320-4726-af9f-05c26a685964 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:26.373980 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5c571af-6320-4726-af9f-05c26a685964 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:26.377818 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5c571af-6320-4726-af9f-05c26a685964 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:26.379107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5c571af-6320-4726-af9f-05c26a685964 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:26.538184 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e5c571af-6320-4726-af9f-05c26a685964 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:26.546734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e5c571af-6320-4726-af9f-05c26a685964 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:26.549914 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e5c571af-6320-4726-af9f-05c26a685964 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:26.551680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e5c571af-6320-4726-af9f-05c26a685964 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.196233 Oct 27 14:12:26.560889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 440/823] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:26 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:26.726877 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-72801193-7a8e-49b6-a712-9e12ea278ddc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:26.727781 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-72801193-7a8e-49b6-a712-9e12ea278ddc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:26.734168 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-72801193-7a8e-49b6-a712-9e12ea278ddc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:26.734891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-72801193-7a8e-49b6-a712-9e12ea278ddc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:26.735845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-72801193-7a8e-49b6-a712-9e12ea278ddc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:26.736455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-72801193-7a8e-49b6-a712-9e12ea278ddc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:26.884809 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-72801193-7a8e-49b6-a712-9e12ea278ddc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:26.897786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-72801193-7a8e-49b6-a712-9e12ea278ddc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.174713 Oct 27 14:12:26.898558 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 441/824] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:26 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:27.570326 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5172478a-4510-4394-ac03-ff9e0497be09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:27.571170 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5172478a-4510-4394-ac03-ff9e0497be09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:27.579518 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5172478a-4510-4394-ac03-ff9e0497be09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:27.580299 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5172478a-4510-4394-ac03-ff9e0497be09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:27.581499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5172478a-4510-4394-ac03-ff9e0497be09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:27.581994 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5172478a-4510-4394-ac03-ff9e0497be09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:27.746802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5172478a-4510-4394-ac03-ff9e0497be09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:27.755225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5172478a-4510-4394-ac03-ff9e0497be09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:27.756731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5172478a-4510-4394-ac03-ff9e0497be09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:27.757896 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5172478a-4510-4394-ac03-ff9e0497be09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.191405 Oct 27 14:12:27.758445 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 442/825] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:27 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:27.915709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4409656c-9119-4282-8f99-d5dee295442a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:27.916765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4409656c-9119-4282-8f99-d5dee295442a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:27.940426 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4409656c-9119-4282-8f99-d5dee295442a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:27.940885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4409656c-9119-4282-8f99-d5dee295442a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:27.941678 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4409656c-9119-4282-8f99-d5dee295442a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:27.942117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4409656c-9119-4282-8f99-d5dee295442a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:28.102720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4409656c-9119-4282-8f99-d5dee295442a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:28.109920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4409656c-9119-4282-8f99-d5dee295442a tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.198253 Oct 27 14:12:28.110569 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 443/826] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:27 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:28.776205 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9007a51b-a775-4a5a-8aff-cde815ca317e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:28.776890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9007a51b-a775-4a5a-8aff-cde815ca317e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:28.783656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9007a51b-a775-4a5a-8aff-cde815ca317e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:28.784096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9007a51b-a775-4a5a-8aff-cde815ca317e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:28.784904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9007a51b-a775-4a5a-8aff-cde815ca317e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:28.785338 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9007a51b-a775-4a5a-8aff-cde815ca317e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:28.926141 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9007a51b-a775-4a5a-8aff-cde815ca317e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:28.938367 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9007a51b-a775-4a5a-8aff-cde815ca317e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:28.940615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9007a51b-a775-4a5a-8aff-cde815ca317e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:28.942424 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9007a51b-a775-4a5a-8aff-cde815ca317e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.170251 Oct 27 14:12:28.943536 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 444/827] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:28 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:29.129817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9a623c0d-8cfe-4ece-b7ca-009d1d51cfbf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:29.130568 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9a623c0d-8cfe-4ece-b7ca-009d1d51cfbf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:29.137711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a623c0d-8cfe-4ece-b7ca-009d1d51cfbf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:29.138537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a623c0d-8cfe-4ece-b7ca-009d1d51cfbf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:29.139342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a623c0d-8cfe-4ece-b7ca-009d1d51cfbf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:29.139776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a623c0d-8cfe-4ece-b7ca-009d1d51cfbf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:29.277757 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9a623c0d-8cfe-4ece-b7ca-009d1d51cfbf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:29.285463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9a623c0d-8cfe-4ece-b7ca-009d1d51cfbf tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.160486 Oct 27 14:12:29.294899 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 445/828] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:29 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:29.961463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fc711abb-6275-4861-acbe-c9dee1ccf226 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:29.962188 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fc711abb-6275-4861-acbe-c9dee1ccf226 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:29.969395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc711abb-6275-4861-acbe-c9dee1ccf226 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:29.970025 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc711abb-6275-4861-acbe-c9dee1ccf226 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:29.971067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc711abb-6275-4861-acbe-c9dee1ccf226 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:29.971636 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc711abb-6275-4861-acbe-c9dee1ccf226 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:30.132776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fc711abb-6275-4861-acbe-c9dee1ccf226 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:30.145124 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fc711abb-6275-4861-acbe-c9dee1ccf226 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:30.146893 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fc711abb-6275-4861-acbe-c9dee1ccf226 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:30.148200 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fc711abb-6275-4861-acbe-c9dee1ccf226 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.190559 Oct 27 14:12:30.149100 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 446/829] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:29 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:30.302521 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5e3d79b3-acfb-45ab-bbb1-18f609382afb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:30.303219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5e3d79b3-acfb-45ab-bbb1-18f609382afb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:30.309185 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e3d79b3-acfb-45ab-bbb1-18f609382afb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:30.309634 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e3d79b3-acfb-45ab-bbb1-18f609382afb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:30.310413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e3d79b3-acfb-45ab-bbb1-18f609382afb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:30.310881 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e3d79b3-acfb-45ab-bbb1-18f609382afb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:30.441265 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5e3d79b3-acfb-45ab-bbb1-18f609382afb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:30.449546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5e3d79b3-acfb-45ab-bbb1-18f609382afb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.151298 Oct 27 14:12:30.450369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 447/830] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:30 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:31.165745 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-58447ef6-aa2b-452e-845c-d85cd09b3c92 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:31.166506 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-58447ef6-aa2b-452e-845c-d85cd09b3c92 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:31.173429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58447ef6-aa2b-452e-845c-d85cd09b3c92 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:31.174055 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58447ef6-aa2b-452e-845c-d85cd09b3c92 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:31.175016 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58447ef6-aa2b-452e-845c-d85cd09b3c92 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:31.175519 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58447ef6-aa2b-452e-845c-d85cd09b3c92 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:31.349368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-58447ef6-aa2b-452e-845c-d85cd09b3c92 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:31.357919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-58447ef6-aa2b-452e-845c-d85cd09b3c92 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:31.359759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-58447ef6-aa2b-452e-845c-d85cd09b3c92 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:31.361259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-58447ef6-aa2b-452e-845c-d85cd09b3c92 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.199083 Oct 27 14:12:31.361651 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 448/831] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:31 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:31.466254 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-27b08d1c-afd3-4a5b-bc96-88b85fe9fb0d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:31.467109 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-27b08d1c-afd3-4a5b-bc96-88b85fe9fb0d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:31.478674 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-27b08d1c-afd3-4a5b-bc96-88b85fe9fb0d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:31.479120 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-27b08d1c-afd3-4a5b-bc96-88b85fe9fb0d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:31.480141 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-27b08d1c-afd3-4a5b-bc96-88b85fe9fb0d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:31.480580 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-27b08d1c-afd3-4a5b-bc96-88b85fe9fb0d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:31.620909 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-27b08d1c-afd3-4a5b-bc96-88b85fe9fb0d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:31.637699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-27b08d1c-afd3-4a5b-bc96-88b85fe9fb0d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.175116 Oct 27 14:12:31.638280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 449/832] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:31 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:32.349496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2097580119", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-707784463", "security_groups": [{"name": "tempest-secgroup-smoke-1023159621"}], "networks": [{"uuid": "ac770c01-1b9a-4b32-bd76-dffbf7a672f5"}], "block_device_mapping_v2": [{"uuid": "62d27774-b8c5-4625-b8d3-9751fb5dac13", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:12:32.453681 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] validate_networks() for [('ac770c01-1b9a-4b32-bd76-dffbf7a672f5', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:12:33.118388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:12:33.119071 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:12:33.119667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:12:33.120245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:12:33.120724 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:12:33.131628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:33.132171 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:33.133108 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:33.133536 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:33.151410 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Getting quotas for project c924da1e65494809b6ceaf4b8a10e166. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:12:33.156303 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Getting quotas for user 0e52a4ba12e74a0b828bb63d198516c3 and project c924da1e65494809b6ceaf4b8a10e166. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:12:33.241042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:12:33.243227 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62d27774-b8c5-4625-b8d3-9751fb5dac13',volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:12:33.419520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8310e57a-31f7-49b8-a8c8-30fce17bd9c4 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.073677 Oct 27 14:12:33.426573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 450/833] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:12:32 2021] POST /compute/v2.1/servers => generated 406 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 14:12:33.432017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0ad60c86-c3ba-494f-9c19-3f6744eb5372 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:33.432957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0ad60c86-c3ba-494f-9c19-3f6744eb5372 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:33.439436 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ad60c86-c3ba-494f-9c19-3f6744eb5372 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:33.439883 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ad60c86-c3ba-494f-9c19-3f6744eb5372 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:33.440657 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ad60c86-c3ba-494f-9c19-3f6744eb5372 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:33.441689 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ad60c86-c3ba-494f-9c19-3f6744eb5372 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:33.664290 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ad60c86-c3ba-494f-9c19-3f6744eb5372 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:33.676912 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ad60c86-c3ba-494f-9c19-3f6744eb5372 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:33.678708 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ad60c86-c3ba-494f-9c19-3f6744eb5372 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:33.680580 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0ad60c86-c3ba-494f-9c19-3f6744eb5372 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.258859 Oct 27 14:12:33.694964 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 451/834] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:33 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:33.700328 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-58616485-a203-47b5-ba17-88d6b1a1b85d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:33.701004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-58616485-a203-47b5-ba17-88d6b1a1b85d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:33.713140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58616485-a203-47b5-ba17-88d6b1a1b85d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:33.713649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58616485-a203-47b5-ba17-88d6b1a1b85d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:33.714527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58616485-a203-47b5-ba17-88d6b1a1b85d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:33.714883 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-58616485-a203-47b5-ba17-88d6b1a1b85d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:33.923624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-58616485-a203-47b5-ba17-88d6b1a1b85d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:33.932113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-58616485-a203-47b5-ba17-88d6b1a1b85d tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.235524 Oct 27 14:12:33.932753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 452/835] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:33 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:33.949596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-628c6b32-b2cf-42ce-990b-76d8d5de55d5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:33.950228 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-628c6b32-b2cf-42ce-990b-76d8d5de55d5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:33.959331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-628c6b32-b2cf-42ce-990b-76d8d5de55d5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:33.959779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-628c6b32-b2cf-42ce-990b-76d8d5de55d5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:33.960572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-628c6b32-b2cf-42ce-990b-76d8d5de55d5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:33.961033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-628c6b32-b2cf-42ce-990b-76d8d5de55d5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:34.034783 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-628c6b32-b2cf-42ce-990b-76d8d5de55d5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:34.043842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-628c6b32-b2cf-42ce-990b-76d8d5de55d5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1138 microversion: 2.1 time: 0.109717 Oct 27 14:12:34.044418 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 453/836] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:33 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1138 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:34.700388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-287bd8f6-8e9b-49fb-acc9-8f83b4b89d8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:34.701034 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-287bd8f6-8e9b-49fb-acc9-8f83b4b89d8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:34.707825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-287bd8f6-8e9b-49fb-acc9-8f83b4b89d8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:34.708273 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-287bd8f6-8e9b-49fb-acc9-8f83b4b89d8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:34.709053 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-287bd8f6-8e9b-49fb-acc9-8f83b4b89d8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:34.709490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-287bd8f6-8e9b-49fb-acc9-8f83b4b89d8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:34.868474 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-287bd8f6-8e9b-49fb-acc9-8f83b4b89d8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:34.877564 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-287bd8f6-8e9b-49fb-acc9-8f83b4b89d8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:34.879649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-287bd8f6-8e9b-49fb-acc9-8f83b4b89d8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:34.880832 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-287bd8f6-8e9b-49fb-acc9-8f83b4b89d8a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.184642 Oct 27 14:12:34.881387 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 454/837] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:34 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:34.949464 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-28da45cc-b60c-4f21-bf0a-8995a9e678dc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:34.950164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-28da45cc-b60c-4f21-bf0a-8995a9e678dc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:34.960029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-28da45cc-b60c-4f21-bf0a-8995a9e678dc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:34.960029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-28da45cc-b60c-4f21-bf0a-8995a9e678dc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:34.960029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-28da45cc-b60c-4f21-bf0a-8995a9e678dc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:34.960029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-28da45cc-b60c-4f21-bf0a-8995a9e678dc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:35.129418 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-28da45cc-b60c-4f21-bf0a-8995a9e678dc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:35.138842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-28da45cc-b60c-4f21-bf0a-8995a9e678dc tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.192986 Oct 27 14:12:35.143462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 455/838] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:34 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:35.148947 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f1a1e3bd-ce67-493a-b9cc-bbbf8677d800 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:35.149772 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f1a1e3bd-ce67-493a-b9cc-bbbf8677d800 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:35.156108 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1a1e3bd-ce67-493a-b9cc-bbbf8677d800 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:35.156553 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1a1e3bd-ce67-493a-b9cc-bbbf8677d800 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:35.157339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1a1e3bd-ce67-493a-b9cc-bbbf8677d800 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:35.157768 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1a1e3bd-ce67-493a-b9cc-bbbf8677d800 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:35.223356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f1a1e3bd-ce67-493a-b9cc-bbbf8677d800 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:35.230934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f1a1e3bd-ce67-493a-b9cc-bbbf8677d800 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1138 microversion: 2.1 time: 0.086123 Oct 27 14:12:35.231502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 456/839] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:35 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:35.899880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0b8bba6f-2115-4c68-b277-17e05f827a78 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:35.900536 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0b8bba6f-2115-4c68-b277-17e05f827a78 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:35.907158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b8bba6f-2115-4c68-b277-17e05f827a78 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:35.907615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b8bba6f-2115-4c68-b277-17e05f827a78 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:35.908397 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b8bba6f-2115-4c68-b277-17e05f827a78 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:35.908980 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b8bba6f-2115-4c68-b277-17e05f827a78 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:36.054292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0b8bba6f-2115-4c68-b277-17e05f827a78 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:36.063553 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0b8bba6f-2115-4c68-b277-17e05f827a78 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:36.065020 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0b8bba6f-2115-4c68-b277-17e05f827a78 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:36.066698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0b8bba6f-2115-4c68-b277-17e05f827a78 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.170703 Oct 27 14:12:36.067757 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 457/840] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:35 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:36.160539 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7ed8d2ff-5564-4bd8-ba11-9800172165c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:36.161245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7ed8d2ff-5564-4bd8-ba11-9800172165c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:36.167269 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ed8d2ff-5564-4bd8-ba11-9800172165c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:36.167743 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ed8d2ff-5564-4bd8-ba11-9800172165c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:36.168552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ed8d2ff-5564-4bd8-ba11-9800172165c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:36.169039 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ed8d2ff-5564-4bd8-ba11-9800172165c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:36.301774 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7ed8d2ff-5564-4bd8-ba11-9800172165c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:36.310912 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7ed8d2ff-5564-4bd8-ba11-9800172165c0 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.154550 Oct 27 14:12:36.311726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 458/841] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:36 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:36.323845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-736ccd5c-9d2c-49d9-8020-10a8a2ffed37 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:36.325371 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-736ccd5c-9d2c-49d9-8020-10a8a2ffed37 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:36.330190 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-736ccd5c-9d2c-49d9-8020-10a8a2ffed37 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:36.330634 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-736ccd5c-9d2c-49d9-8020-10a8a2ffed37 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:36.331429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-736ccd5c-9d2c-49d9-8020-10a8a2ffed37 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:36.332404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-736ccd5c-9d2c-49d9-8020-10a8a2ffed37 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:36.409276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-736ccd5c-9d2c-49d9-8020-10a8a2ffed37 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:36.422131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-736ccd5c-9d2c-49d9-8020-10a8a2ffed37 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1138 microversion: 2.1 time: 0.101308 Oct 27 14:12:36.423029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 459/842] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:36 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1138 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:37.086297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-df73ffb2-3d4f-43ae-bab8-462d69e6c318 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:37.087012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-df73ffb2-3d4f-43ae-bab8-462d69e6c318 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:37.093210 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df73ffb2-3d4f-43ae-bab8-462d69e6c318 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:37.093661 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df73ffb2-3d4f-43ae-bab8-462d69e6c318 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:37.094436 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df73ffb2-3d4f-43ae-bab8-462d69e6c318 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:37.094929 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df73ffb2-3d4f-43ae-bab8-462d69e6c318 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:37.226475 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-df73ffb2-3d4f-43ae-bab8-462d69e6c318 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:37.235288 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-df73ffb2-3d4f-43ae-bab8-462d69e6c318 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:37.236813 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-df73ffb2-3d4f-43ae-bab8-462d69e6c318 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:37.238553 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-df73ffb2-3d4f-43ae-bab8-462d69e6c318 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.155699 Oct 27 14:12:37.239340 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 460/843] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:37 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:37.279315 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f755263f-de63-4612-81ff-941ceed9d132 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:37.280492 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f755263f-de63-4612-81ff-941ceed9d132 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:37.287869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f755263f-de63-4612-81ff-941ceed9d132 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:37.288403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f755263f-de63-4612-81ff-941ceed9d132 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:37.289248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f755263f-de63-4612-81ff-941ceed9d132 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:37.289752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f755263f-de63-4612-81ff-941ceed9d132 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:37.370017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-f755263f-de63-4612-81ff-941ceed9d132 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lazy-loading 'services' on Instance uuid 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:12:37.443643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f755263f-de63-4612-81ff-941ceed9d132 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "DELETE /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/os-volume_attachments/03ff9056-eaf2-49ef-8796-080c53bc4dba" status: 202 len: 0 microversion: 2.1 time: 0.168113 Oct 27 14:12:37.444322 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 461/844] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:12:37 2021] DELETE /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/os-volume_attachments/03ff9056-eaf2-49ef-8796-080c53bc4dba => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:12:37.449884 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-211050de-2381-40e1-af2c-1e419a4bf7f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:37.450704 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-211050de-2381-40e1-af2c-1e419a4bf7f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:37.458962 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-211050de-2381-40e1-af2c-1e419a4bf7f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:37.459524 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-211050de-2381-40e1-af2c-1e419a4bf7f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:37.460462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-211050de-2381-40e1-af2c-1e419a4bf7f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:37.460929 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-211050de-2381-40e1-af2c-1e419a4bf7f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:37.596461 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-211050de-2381-40e1-af2c-1e419a4bf7f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:37.604535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-211050de-2381-40e1-af2c-1e419a4bf7f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.159061 Oct 27 14:12:37.605098 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 462/845] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:37 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:37.609490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cae6a3b4-9d9e-4557-8ab3-ddc1bb799324 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:37.610111 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cae6a3b4-9d9e-4557-8ab3-ddc1bb799324 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:37.616141 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cae6a3b4-9d9e-4557-8ab3-ddc1bb799324 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:37.616587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cae6a3b4-9d9e-4557-8ab3-ddc1bb799324 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:37.617363 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cae6a3b4-9d9e-4557-8ab3-ddc1bb799324 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:37.617792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cae6a3b4-9d9e-4557-8ab3-ddc1bb799324 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:37.680086 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-cae6a3b4-9d9e-4557-8ab3-ddc1bb799324 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:37.687817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cae6a3b4-9d9e-4557-8ab3-ddc1bb799324 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1138 microversion: 2.1 time: 0.081762 Oct 27 14:12:37.688380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 463/846] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:37 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:38.261917 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ef115538-4e84-406d-b384-a64e9d7a56fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:38.264325 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ef115538-4e84-406d-b384-a64e9d7a56fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:38.271769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef115538-4e84-406d-b384-a64e9d7a56fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:38.272300 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef115538-4e84-406d-b384-a64e9d7a56fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:38.273098 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef115538-4e84-406d-b384-a64e9d7a56fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:38.273986 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef115538-4e84-406d-b384-a64e9d7a56fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:38.421352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ef115538-4e84-406d-b384-a64e9d7a56fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:38.431465 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ef115538-4e84-406d-b384-a64e9d7a56fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:38.432991 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ef115538-4e84-406d-b384-a64e9d7a56fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:38.434162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ef115538-4e84-406d-b384-a64e9d7a56fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.177756 Oct 27 14:12:38.434729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 464/847] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:38 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:38.622002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-262e9d7a-3908-42ec-b03c-7405319a0c61 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:38.622610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-262e9d7a-3908-42ec-b03c-7405319a0c61 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:38.629458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-262e9d7a-3908-42ec-b03c-7405319a0c61 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:38.629994 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-262e9d7a-3908-42ec-b03c-7405319a0c61 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:38.630768 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-262e9d7a-3908-42ec-b03c-7405319a0c61 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:38.631239 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-262e9d7a-3908-42ec-b03c-7405319a0c61 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:38.756255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-262e9d7a-3908-42ec-b03c-7405319a0c61 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:38.764692 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-262e9d7a-3908-42ec-b03c-7405319a0c61 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.146372 Oct 27 14:12:38.765196 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 465/848] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:38 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:38.770436 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d29ab3a1-7071-4a9d-bff0-f50f2673cf9e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:38.771179 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d29ab3a1-7071-4a9d-bff0-f50f2673cf9e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:38.777077 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d29ab3a1-7071-4a9d-bff0-f50f2673cf9e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:38.777527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d29ab3a1-7071-4a9d-bff0-f50f2673cf9e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:38.778295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d29ab3a1-7071-4a9d-bff0-f50f2673cf9e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:38.778731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d29ab3a1-7071-4a9d-bff0-f50f2673cf9e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:38.838605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d29ab3a1-7071-4a9d-bff0-f50f2673cf9e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:38.845784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d29ab3a1-7071-4a9d-bff0-f50f2673cf9e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1186 microversion: 2.1 time: 0.079652 Oct 27 14:12:38.846334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 466/849] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:38 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1186 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:39.454562 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-12d86efd-2e53-456f-97cd-1dd1ffac74dd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:39.456030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-12d86efd-2e53-456f-97cd-1dd1ffac74dd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:39.463704 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-12d86efd-2e53-456f-97cd-1dd1ffac74dd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:39.464239 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-12d86efd-2e53-456f-97cd-1dd1ffac74dd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:39.469711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-12d86efd-2e53-456f-97cd-1dd1ffac74dd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:39.469711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-12d86efd-2e53-456f-97cd-1dd1ffac74dd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:39.666511 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-12d86efd-2e53-456f-97cd-1dd1ffac74dd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:39.684507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-12d86efd-2e53-456f-97cd-1dd1ffac74dd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:39.686105 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-12d86efd-2e53-456f-97cd-1dd1ffac74dd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:39.687313 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-12d86efd-2e53-456f-97cd-1dd1ffac74dd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.238207 Oct 27 14:12:39.688031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 467/850] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:39 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:39.788259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4de9624b-e325-42db-b5dd-2551b361ebed tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:39.788259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4de9624b-e325-42db-b5dd-2551b361ebed tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:39.802053 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4de9624b-e325-42db-b5dd-2551b361ebed tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:39.802709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4de9624b-e325-42db-b5dd-2551b361ebed tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:39.803611 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4de9624b-e325-42db-b5dd-2551b361ebed tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:39.804111 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4de9624b-e325-42db-b5dd-2551b361ebed tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:40.031601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4de9624b-e325-42db-b5dd-2551b361ebed tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:40.039824 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4de9624b-e325-42db-b5dd-2551b361ebed tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.261639 Oct 27 14:12:40.040943 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 468/851] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:39 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:40.045373 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a30318a0-9d56-46f8-9f7e-d9725a08cf67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:40.045975 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a30318a0-9d56-46f8-9f7e-d9725a08cf67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:40.052488 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a30318a0-9d56-46f8-9f7e-d9725a08cf67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:40.052874 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a30318a0-9d56-46f8-9f7e-d9725a08cf67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:40.053726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a30318a0-9d56-46f8-9f7e-d9725a08cf67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:40.054427 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a30318a0-9d56-46f8-9f7e-d9725a08cf67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:40.268456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a30318a0-9d56-46f8-9f7e-d9725a08cf67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:40.277470 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a30318a0-9d56-46f8-9f7e-d9725a08cf67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1272 microversion: 2.1 time: 0.235024 Oct 27 14:12:40.278194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 469/852] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:40 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:40.705790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1733feeb-c3a4-4dab-bcf1-8c9e62218f1b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:40.706472 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1733feeb-c3a4-4dab-bcf1-8c9e62218f1b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:40.714219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1733feeb-c3a4-4dab-bcf1-8c9e62218f1b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:40.714732 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1733feeb-c3a4-4dab-bcf1-8c9e62218f1b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:40.715601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1733feeb-c3a4-4dab-bcf1-8c9e62218f1b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:40.716128 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1733feeb-c3a4-4dab-bcf1-8c9e62218f1b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:40.915108 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1733feeb-c3a4-4dab-bcf1-8c9e62218f1b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:40.923317 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1733feeb-c3a4-4dab-bcf1-8c9e62218f1b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:40.924798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1733feeb-c3a4-4dab-bcf1-8c9e62218f1b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:40.925989 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1733feeb-c3a4-4dab-bcf1-8c9e62218f1b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.223939 Oct 27 14:12:40.926541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 470/853] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:40 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:41.056892 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6257654a-787f-4f80-a102-7cc976c9385c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:41.057628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6257654a-787f-4f80-a102-7cc976c9385c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:41.063538 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6257654a-787f-4f80-a102-7cc976c9385c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:41.063980 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6257654a-787f-4f80-a102-7cc976c9385c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:41.064739 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6257654a-787f-4f80-a102-7cc976c9385c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:41.065166 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6257654a-787f-4f80-a102-7cc976c9385c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:41.201581 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6257654a-787f-4f80-a102-7cc976c9385c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:41.209653 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6257654a-787f-4f80-a102-7cc976c9385c tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1506 microversion: 2.1 time: 0.156453 Oct 27 14:12:41.210226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 471/854] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:41 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:41.296006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1d1da589-9157-411c-860b-c428d578d170 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:41.296607 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1d1da589-9157-411c-860b-c428d578d170 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:41.302453 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d1da589-9157-411c-860b-c428d578d170 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:41.302897 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d1da589-9157-411c-860b-c428d578d170 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:41.303697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d1da589-9157-411c-860b-c428d578d170 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:41.304131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d1da589-9157-411c-860b-c428d578d170 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:41.444295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1d1da589-9157-411c-860b-c428d578d170 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:41.453513 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1d1da589-9157-411c-860b-c428d578d170 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1272 microversion: 2.1 time: 0.160828 Oct 27 14:12:41.454345 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 472/855] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:41 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:41.944880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0bf819af-1269-470c-8e68-5e6916367015 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:41.945560 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0bf819af-1269-470c-8e68-5e6916367015 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:41.952672 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0bf819af-1269-470c-8e68-5e6916367015 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:41.953427 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0bf819af-1269-470c-8e68-5e6916367015 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:41.954407 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0bf819af-1269-470c-8e68-5e6916367015 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:41.955023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0bf819af-1269-470c-8e68-5e6916367015 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:42.162143 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0bf819af-1269-470c-8e68-5e6916367015 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:42.174284 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0bf819af-1269-470c-8e68-5e6916367015 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:42.177720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0bf819af-1269-470c-8e68-5e6916367015 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:42.179218 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0bf819af-1269-470c-8e68-5e6916367015 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.238930 Oct 27 14:12:42.190616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 473/856] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:41 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:42.232081 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5cafda47-d626-4769-b45d-1f0e26606268 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:42.233685 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5cafda47-d626-4769-b45d-1f0e26606268 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:42.240835 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5cafda47-d626-4769-b45d-1f0e26606268 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:42.243014 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5cafda47-d626-4769-b45d-1f0e26606268 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:42.244114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5cafda47-d626-4769-b45d-1f0e26606268 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:42.244765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5cafda47-d626-4769-b45d-1f0e26606268 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:42.325331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5cafda47-d626-4769-b45d-1f0e26606268 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:42.334549 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5cafda47-d626-4769-b45d-1f0e26606268 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 200 len: 1464 microversion: 2.1 time: 0.108474 Oct 27 14:12:42.344795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 474/857] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:42 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 1464 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:42.469765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8f3c424f-b743-46c5-9dab-d92ee8c2ce49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:42.470567 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8f3c424f-b743-46c5-9dab-d92ee8c2ce49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:42.476639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f3c424f-b743-46c5-9dab-d92ee8c2ce49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:42.477212 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f3c424f-b743-46c5-9dab-d92ee8c2ce49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:42.478082 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f3c424f-b743-46c5-9dab-d92ee8c2ce49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:42.478602 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f3c424f-b743-46c5-9dab-d92ee8c2ce49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:42.610414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8f3c424f-b743-46c5-9dab-d92ee8c2ce49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:42.618999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8f3c424f-b743-46c5-9dab-d92ee8c2ce49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1272 microversion: 2.1 time: 0.152906 Oct 27 14:12:42.633589 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 475/858] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:42 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:43.197686 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-41c6667d-a0a8-4722-ad63-f54bd91d77a9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:43.198365 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-41c6667d-a0a8-4722-ad63-f54bd91d77a9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:43.204452 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41c6667d-a0a8-4722-ad63-f54bd91d77a9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:43.204895 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41c6667d-a0a8-4722-ad63-f54bd91d77a9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:43.205675 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41c6667d-a0a8-4722-ad63-f54bd91d77a9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:43.206105 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41c6667d-a0a8-4722-ad63-f54bd91d77a9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:43.340261 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-41c6667d-a0a8-4722-ad63-f54bd91d77a9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:43.348765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-41c6667d-a0a8-4722-ad63-f54bd91d77a9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:43.350267 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-41c6667d-a0a8-4722-ad63-f54bd91d77a9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:43.351452 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-41c6667d-a0a8-4722-ad63-f54bd91d77a9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.157507 Oct 27 14:12:43.352008 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 476/859] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:43 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:43.356198 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ddea1b32-a6c9-4674-89d1-55b969ac6311 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:43.356794 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ddea1b32-a6c9-4674-89d1-55b969ac6311 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: 70957fff-2020-4c1f-8829-004a5b2cb3f8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:43.362499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ddea1b32-a6c9-4674-89d1-55b969ac6311 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:43.363038 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ddea1b32-a6c9-4674-89d1-55b969ac6311 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:43.364186 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ddea1b32-a6c9-4674-89d1-55b969ac6311 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:43.364640 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ddea1b32-a6c9-4674-89d1-55b969ac6311 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:43.382255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-ddea1b32-a6c9-4674-89d1-55b969ac6311 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] HTTP exception thrown: Instance 70957fff-2020-4c1f-8829-004a5b2cb3f8 could not be found. Oct 27 14:12:43.382851 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ddea1b32-a6c9-4674-89d1-55b969ac6311 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Returning 404 to user: Instance 70957fff-2020-4c1f-8829-004a5b2cb3f8 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:12:43.383779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ddea1b32-a6c9-4674-89d1-55b969ac6311 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8" status: 404 len: 111 microversion: 2.1 time: 0.030831 Oct 27 14:12:43.384383 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 477/860] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:43 2021] GET /compute/v2.1/servers/70957fff-2020-4c1f-8829-004a5b2cb3f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:12:43.392405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dea8c528-dcee-4e50-a16c-3ccbbd921354 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:43.392903 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dea8c528-dcee-4e50-a16c-3ccbbd921354 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:43.399604 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dea8c528-dcee-4e50-a16c-3ccbbd921354 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:43.400055 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dea8c528-dcee-4e50-a16c-3ccbbd921354 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:43.400830 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dea8c528-dcee-4e50-a16c-3ccbbd921354 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:43.401261 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dea8c528-dcee-4e50-a16c-3ccbbd921354 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:43.426866 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dea8c528-dcee-4e50-a16c-3ccbbd921354 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:12:43.508469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dea8c528-dcee-4e50-a16c-3ccbbd921354 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "DELETE /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 204 len: 0 microversion: 2.1 time: 0.118849 Oct 27 14:12:43.509151 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 478/861] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:12:43 2021] DELETE /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:12:43.519593 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a67090c6-bce7-4679-b834-def8964a91a4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:43.520509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a67090c6-bce7-4679-b834-def8964a91a4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:43.526475 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a67090c6-bce7-4679-b834-def8964a91a4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:43.526918 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a67090c6-bce7-4679-b834-def8964a91a4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:43.527727 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a67090c6-bce7-4679-b834-def8964a91a4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:43.528155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a67090c6-bce7-4679-b834-def8964a91a4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:43.699021 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a67090c6-bce7-4679-b834-def8964a91a4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:43.708563 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a67090c6-bce7-4679-b834-def8964a91a4 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.193754 Oct 27 14:12:43.709173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 479/862] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:43 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:43.713798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0f88a936-0059-4bbd-add9-20d95128ffba tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:43.714402 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0f88a936-0059-4bbd-add9-20d95128ffba tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:43.720245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0f88a936-0059-4bbd-add9-20d95128ffba tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:43.720826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0f88a936-0059-4bbd-add9-20d95128ffba tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:43.721618 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0f88a936-0059-4bbd-add9-20d95128ffba tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:43.722059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0f88a936-0059-4bbd-add9-20d95128ffba tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:43.925198 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0f88a936-0059-4bbd-add9-20d95128ffba tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:43.932545 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0f88a936-0059-4bbd-add9-20d95128ffba tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1272 microversion: 2.1 time: 0.222322 Oct 27 14:12:43.933114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 480/863] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:43 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:44.370144 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3e500ffa-0db2-4e57-b160-09f43fd3b9ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:44.371039 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3e500ffa-0db2-4e57-b160-09f43fd3b9ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:44.377405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3e500ffa-0db2-4e57-b160-09f43fd3b9ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:44.377966 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3e500ffa-0db2-4e57-b160-09f43fd3b9ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:44.378939 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3e500ffa-0db2-4e57-b160-09f43fd3b9ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:44.380012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3e500ffa-0db2-4e57-b160-09f43fd3b9ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:44.543438 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3e500ffa-0db2-4e57-b160-09f43fd3b9ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:44.559612 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3e500ffa-0db2-4e57-b160-09f43fd3b9ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:44.562137 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3e500ffa-0db2-4e57-b160-09f43fd3b9ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:44.563568 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3e500ffa-0db2-4e57-b160-09f43fd3b9ec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.197050 Oct 27 14:12:44.564291 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 481/864] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:44 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:44.726173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-412f6dc3-69da-4f1e-ad97-ca2a2847c4c9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:44.726788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-412f6dc3-69da-4f1e-ad97-ca2a2847c4c9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:44.732822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-412f6dc3-69da-4f1e-ad97-ca2a2847c4c9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:44.733250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-412f6dc3-69da-4f1e-ad97-ca2a2847c4c9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:44.734033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-412f6dc3-69da-4f1e-ad97-ca2a2847c4c9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:44.734473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-412f6dc3-69da-4f1e-ad97-ca2a2847c4c9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:44.860428 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-412f6dc3-69da-4f1e-ad97-ca2a2847c4c9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:44.872594 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-412f6dc3-69da-4f1e-ad97-ca2a2847c4c9 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.150630 Oct 27 14:12:44.873678 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 482/865] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:44 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:44.949980 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2a8e46d1-5fcf-48b7-a725-265390382918 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:44.950737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2a8e46d1-5fcf-48b7-a725-265390382918 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:44.958028 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a8e46d1-5fcf-48b7-a725-265390382918 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:44.958641 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a8e46d1-5fcf-48b7-a725-265390382918 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:44.959650 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a8e46d1-5fcf-48b7-a725-265390382918 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:44.960163 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a8e46d1-5fcf-48b7-a725-265390382918 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:45.092626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2a8e46d1-5fcf-48b7-a725-265390382918 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:45.100084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2a8e46d1-5fcf-48b7-a725-265390382918 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1272 microversion: 2.1 time: 0.154258 Oct 27 14:12:45.100668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 483/866] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:44 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:45.584114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f3a2d168-06b0-4315-8c9d-0f7d9f01befc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:45.585791 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f3a2d168-06b0-4315-8c9d-0f7d9f01befc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:45.594644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f3a2d168-06b0-4315-8c9d-0f7d9f01befc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:45.595400 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f3a2d168-06b0-4315-8c9d-0f7d9f01befc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:45.596383 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f3a2d168-06b0-4315-8c9d-0f7d9f01befc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:45.597084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f3a2d168-06b0-4315-8c9d-0f7d9f01befc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:45.745495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f3a2d168-06b0-4315-8c9d-0f7d9f01befc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:45.763776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f3a2d168-06b0-4315-8c9d-0f7d9f01befc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:45.766091 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f3a2d168-06b0-4315-8c9d-0f7d9f01befc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:45.767953 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f3a2d168-06b0-4315-8c9d-0f7d9f01befc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.189145 Oct 27 14:12:45.769046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 484/867] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:45 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:45.817340 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-76787f1b-dc24-4dc1-90cd-5dec4c252ca8 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:45.818114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-76787f1b-dc24-4dc1-90cd-5dec4c252ca8 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:45.824027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76787f1b-dc24-4dc1-90cd-5dec4c252ca8 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:45.824541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76787f1b-dc24-4dc1-90cd-5dec4c252ca8 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:45.825365 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76787f1b-dc24-4dc1-90cd-5dec4c252ca8 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:45.825793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-76787f1b-dc24-4dc1-90cd-5dec4c252ca8 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:45.957584 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-76787f1b-dc24-4dc1-90cd-5dec4c252ca8 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:45.966608 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-76787f1b-dc24-4dc1-90cd-5dec4c252ca8 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1595 microversion: 2.1 time: 0.153509 Oct 27 14:12:45.967386 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 485/868] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:45 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:45.972037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-85ea8b98-a6da-4702-94c4-26d33e376082 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:45.973592 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-85ea8b98-a6da-4702-94c4-26d33e376082 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:45.980183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85ea8b98-a6da-4702-94c4-26d33e376082 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:45.980747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85ea8b98-a6da-4702-94c4-26d33e376082 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:45.981713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85ea8b98-a6da-4702-94c4-26d33e376082 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:45.982554 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85ea8b98-a6da-4702-94c4-26d33e376082 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:46.153244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-85ea8b98-a6da-4702-94c4-26d33e376082 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:46.161910 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-85ea8b98-a6da-4702-94c4-26d33e376082 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.193348 Oct 27 14:12:46.162490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 486/869] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:45 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:46.169331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4b101531-6f65-4d4b-b83d-8a50d5d28b26 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:46.169892 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4b101531-6f65-4d4b-b83d-8a50d5d28b26 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:46.177093 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4b101531-6f65-4d4b-b83d-8a50d5d28b26 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:46.177551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4b101531-6f65-4d4b-b83d-8a50d5d28b26 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:46.178541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4b101531-6f65-4d4b-b83d-8a50d5d28b26 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:46.178982 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4b101531-6f65-4d4b-b83d-8a50d5d28b26 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:46.212138 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4b101531-6f65-4d4b-b83d-8a50d5d28b26 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:12:46.294665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4b101531-6f65-4d4b-b83d-8a50d5d28b26 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 204 len: 0 microversion: 2.1 time: 0.129369 Oct 27 14:12:46.295320 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 487/870] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:12:46 2021] DELETE /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:12:46.301018 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d7148b81-fb45-4605-ba14-614c8a47495e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:46.302008 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d7148b81-fb45-4605-ba14-614c8a47495e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:46.309519 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7148b81-fb45-4605-ba14-614c8a47495e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:46.309978 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7148b81-fb45-4605-ba14-614c8a47495e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:46.310766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7148b81-fb45-4605-ba14-614c8a47495e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:46.311264 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d7148b81-fb45-4605-ba14-614c8a47495e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:46.442959 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d7148b81-fb45-4605-ba14-614c8a47495e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:46.450889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d7148b81-fb45-4605-ba14-614c8a47495e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1272 microversion: 2.1 time: 0.153997 Oct 27 14:12:46.451645 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 488/871] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:46 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:46.460852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5ed9d06b-4a79-4124-9f2d-253c0a219f57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:46.460852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5ed9d06b-4a79-4124-9f2d-253c0a219f57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:46.463558 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5ed9d06b-4a79-4124-9f2d-253c0a219f57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:46.464135 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5ed9d06b-4a79-4124-9f2d-253c0a219f57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:46.464932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5ed9d06b-4a79-4124-9f2d-253c0a219f57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:46.465374 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5ed9d06b-4a79-4124-9f2d-253c0a219f57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:46.600729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5ed9d06b-4a79-4124-9f2d-253c0a219f57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:46.609658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5ed9d06b-4a79-4124-9f2d-253c0a219f57 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1512 microversion: 2.1 time: 0.155519 Oct 27 14:12:46.610818 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 489/872] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:46 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:46.787409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6cb6c841-b810-4153-b972-b4cfad4b30cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:46.788137 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6cb6c841-b810-4153-b972-b4cfad4b30cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:46.794091 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6cb6c841-b810-4153-b972-b4cfad4b30cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:46.794639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6cb6c841-b810-4153-b972-b4cfad4b30cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:46.795534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6cb6c841-b810-4153-b972-b4cfad4b30cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:46.795967 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6cb6c841-b810-4153-b972-b4cfad4b30cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:46.919435 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6cb6c841-b810-4153-b972-b4cfad4b30cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:46.929555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6cb6c841-b810-4153-b972-b4cfad4b30cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:46.931056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6cb6c841-b810-4153-b972-b4cfad4b30cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:46.932252 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6cb6c841-b810-4153-b972-b4cfad4b30cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.149364 Oct 27 14:12:46.932999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 490/873] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:46 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:47.025146 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6af82397-edb4-41b5-9dc2-b865363efe11 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:12:47.031148 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6af82397-edb4-41b5-9dc2-b865363efe11 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.031604 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6af82397-edb4-41b5-9dc2-b865363efe11 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:47.056225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6af82397-edb4-41b5-9dc2-b865363efe11 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Going to try to stop instance {{(pid=115931) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 27 14:12:47.104073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6af82397-edb4-41b5-9dc2-b865363efe11 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 202 len: 0 microversion: 2.1 time: 0.082470 Oct 27 14:12:47.104900 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 491/874] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:12:47 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:12:47.114236 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c72bbb10-e351-43b0-b221-39810edda7c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:47.114935 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c72bbb10-e351-43b0-b221-39810edda7c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:47.121627 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c72bbb10-e351-43b0-b221-39810edda7c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.122313 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c72bbb10-e351-43b0-b221-39810edda7c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:47.123300 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c72bbb10-e351-43b0-b221-39810edda7c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.123901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c72bbb10-e351-43b0-b221-39810edda7c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:47.311787 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c72bbb10-e351-43b0-b221-39810edda7c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:47.324359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c72bbb10-e351-43b0-b221-39810edda7c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.214011 Oct 27 14:12:47.325547 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 492/875] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:47 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:47.336283 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a74e01a1-ad4a-4b21-aadd-6369a1ec79f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:47.336891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a74e01a1-ad4a-4b21-aadd-6369a1ec79f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:47.355731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74e01a1-ad4a-4b21-aadd-6369a1ec79f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.356176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74e01a1-ad4a-4b21-aadd-6369a1ec79f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:47.356974 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74e01a1-ad4a-4b21-aadd-6369a1ec79f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.357409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74e01a1-ad4a-4b21-aadd-6369a1ec79f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:47.543084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a74e01a1-ad4a-4b21-aadd-6369a1ec79f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:47.555331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a74e01a1-ad4a-4b21-aadd-6369a1ec79f6 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.224326 Oct 27 14:12:47.556003 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 493/876] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:47 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:47.562931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d3a2ec92-35df-4d45-af57-356effbbe95c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:47.563594 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d3a2ec92-35df-4d45-af57-356effbbe95c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:47.570662 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3a2ec92-35df-4d45-af57-356effbbe95c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.571262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3a2ec92-35df-4d45-af57-356effbbe95c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:47.572115 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3a2ec92-35df-4d45-af57-356effbbe95c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.572616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3a2ec92-35df-4d45-af57-356effbbe95c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:47.708446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d3a2ec92-35df-4d45-af57-356effbbe95c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:47.716028 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d3a2ec92-35df-4d45-af57-356effbbe95c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.158944 Oct 27 14:12:47.716603 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 494/877] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:47 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:47.720856 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-57e5bf7f-4679-438b-bc76-282ed07477f6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:47.721468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-57e5bf7f-4679-438b-bc76-282ed07477f6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:47.728065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57e5bf7f-4679-438b-bc76-282ed07477f6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.728514 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57e5bf7f-4679-438b-bc76-282ed07477f6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:47.729289 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57e5bf7f-4679-438b-bc76-282ed07477f6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.729722 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57e5bf7f-4679-438b-bc76-282ed07477f6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:47.855444 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-57e5bf7f-4679-438b-bc76-282ed07477f6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:47.862718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-57e5bf7f-4679-438b-bc76-282ed07477f6 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1512 microversion: 2.1 time: 0.145147 Oct 27 14:12:47.863412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 495/878] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:47 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1512 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:47.950614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d338e5a8-8cf8-4c09-a3a7-6f166addaa04 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:47.951255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d338e5a8-8cf8-4c09-a3a7-6f166addaa04 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:47.956951 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d338e5a8-8cf8-4c09-a3a7-6f166addaa04 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.957987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d338e5a8-8cf8-4c09-a3a7-6f166addaa04 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:47.959435 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d338e5a8-8cf8-4c09-a3a7-6f166addaa04 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:47.959874 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d338e5a8-8cf8-4c09-a3a7-6f166addaa04 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:48.092241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d338e5a8-8cf8-4c09-a3a7-6f166addaa04 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:48.100891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d338e5a8-8cf8-4c09-a3a7-6f166addaa04 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:48.102416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d338e5a8-8cf8-4c09-a3a7-6f166addaa04 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:48.103594 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d338e5a8-8cf8-4c09-a3a7-6f166addaa04 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.156802 Oct 27 14:12:48.104155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 496/879] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:47 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:48.190649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-3f38d8fa-38aa-4dca-9f38-a117cbefb1a5 req-bd013c67-6891-4858-8da4-09200038a9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d115154-f737-44a1-83d0-3ed7b44ab9f5", "tag": "d7dbd7ad-d681-4b28-a600-73b66f728573"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:12:48.193267 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:12:48.193267 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:12:48.203012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-3f38d8fa-38aa-4dca-9f38-a117cbefb1a5 req-bd013c67-6891-4858-8da4-09200038a9ca service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:48.203496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-3f38d8fa-38aa-4dca-9f38-a117cbefb1a5 req-bd013c67-6891-4858-8da4-09200038a9ca service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:48.220648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-3f38d8fa-38aa-4dca-9f38-a117cbefb1a5 req-bd013c67-6891-4858-8da4-09200038a9ca service nova] Creating event network-changed:d7dbd7ad-d681-4b28-a600-73b66f728573 for instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 on hv-cinder-81566 Oct 27 14:12:48.227048 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-3f38d8fa-38aa-4dca-9f38-a117cbefb1a5 req-bd013c67-6891-4858-8da4-09200038a9ca service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039956 Oct 27 14:12:48.227915 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 497/880] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:12:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:12:48.391030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c541365f-8f2f-45c5-96a0-8cd6be907edb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:48.391779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c541365f-8f2f-45c5-96a0-8cd6be907edb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:48.404345 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c541365f-8f2f-45c5-96a0-8cd6be907edb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:48.404812 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c541365f-8f2f-45c5-96a0-8cd6be907edb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:48.405619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c541365f-8f2f-45c5-96a0-8cd6be907edb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:48.406057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c541365f-8f2f-45c5-96a0-8cd6be907edb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:48.926254 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c541365f-8f2f-45c5-96a0-8cd6be907edb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:48.936546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c541365f-8f2f-45c5-96a0-8cd6be907edb tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.549069 Oct 27 14:12:48.937496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 498/881] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:48 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:48.951493 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dfcb6ae9-fa72-4919-9f7c-da4bc86baaeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:48.952175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dfcb6ae9-fa72-4919-9f7c-da4bc86baaeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:48.959555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfcb6ae9-fa72-4919-9f7c-da4bc86baaeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:48.960554 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfcb6ae9-fa72-4919-9f7c-da4bc86baaeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:48.961639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfcb6ae9-fa72-4919-9f7c-da4bc86baaeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:48.967623 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfcb6ae9-fa72-4919-9f7c-da4bc86baaeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:49.210712 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-dfcb6ae9-fa72-4919-9f7c-da4bc86baaeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:49.218984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dfcb6ae9-fa72-4919-9f7c-da4bc86baaeb tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.280343 Oct 27 14:12:49.219869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 499/882] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:48 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:49.233298 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-99fc89b0-8906-439d-8824-1b179e016559 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:49.233905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-99fc89b0-8906-439d-8824-1b179e016559 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:49.247838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-99fc89b0-8906-439d-8824-1b179e016559 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:49.248291 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-99fc89b0-8906-439d-8824-1b179e016559 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:49.249711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-99fc89b0-8906-439d-8824-1b179e016559 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:49.250162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-99fc89b0-8906-439d-8824-1b179e016559 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:49.528992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-99fc89b0-8906-439d-8824-1b179e016559 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:49.536961 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-99fc89b0-8906-439d-8824-1b179e016559 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.315680 Oct 27 14:12:49.546825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 500/883] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:49 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:49.553297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-30b4c94c-bc97-4418-a09b-e7650a9edbac tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:49.563867 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-30b4c94c-bc97-4418-a09b-e7650a9edbac tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:49.579084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-30b4c94c-bc97-4418-a09b-e7650a9edbac tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:49.580313 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-30b4c94c-bc97-4418-a09b-e7650a9edbac tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:49.581112 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-30b4c94c-bc97-4418-a09b-e7650a9edbac tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:49.581551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-30b4c94c-bc97-4418-a09b-e7650a9edbac tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:49.835248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-30b4c94c-bc97-4418-a09b-e7650a9edbac tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '003eebaf9aa14c90ade79784224c49a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557227f6d404acba108444e2f807bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:49.842556 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-30b4c94c-bc97-4418-a09b-e7650a9edbac tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 200 len: 1512 microversion: 2.1 time: 0.294239 Oct 27 14:12:49.843480 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 501/884] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:49 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:49.848412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-180ff71a-78fa-494b-b364-76628e861f5c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:49.849154 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-180ff71a-78fa-494b-b364-76628e861f5c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:49.854758 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-180ff71a-78fa-494b-b364-76628e861f5c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:49.855239 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-180ff71a-78fa-494b-b364-76628e861f5c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:49.856003 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-180ff71a-78fa-494b-b364-76628e861f5c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:49.856430 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-180ff71a-78fa-494b-b364-76628e861f5c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:50.042304 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-180ff71a-78fa-494b-b364-76628e861f5c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:50.071456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-180ff71a-78fa-494b-b364-76628e861f5c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:50.073473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-180ff71a-78fa-494b-b364-76628e861f5c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:50.078343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-180ff71a-78fa-494b-b364-76628e861f5c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.234032 Oct 27 14:12:50.079117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 502/885] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:49 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:50.102803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-023059c5-637a-44f0-b606-b09140bc42ba tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2071530249"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:12:50.103438 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-023059c5-637a-44f0-b606-b09140bc42ba tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:50.109856 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-023059c5-637a-44f0-b606-b09140bc42ba tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:50.110307 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-023059c5-637a-44f0-b606-b09140bc42ba tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:50.111171 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-023059c5-637a-44f0-b606-b09140bc42ba tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:50.111609 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-023059c5-637a-44f0-b606-b09140bc42ba tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:50.262966 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.network.security_group_api [None req-023059c5-637a-44f0-b606-b09140bc42ba tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Adding security group cd50fbfa-f142-4652-8802-f751ca5456e6 to port d7dbd7ad-d681-4b28-a600-73b66f728573 Oct 27 14:12:50.622313 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-023059c5-637a-44f0-b606-b09140bc42ba tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "POST /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.541951 Oct 27 14:12:50.624624 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 503/886] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:12:50 2021] POST /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:12:50.632047 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0ba508a6-6c5f-4748-a6e0-8a9e7773b242 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:50.634696 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0ba508a6-6c5f-4748-a6e0-8a9e7773b242 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:50.657709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ba508a6-6c5f-4748-a6e0-8a9e7773b242 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:50.658616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ba508a6-6c5f-4748-a6e0-8a9e7773b242 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:50.659194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ba508a6-6c5f-4748-a6e0-8a9e7773b242 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:50.659692 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ba508a6-6c5f-4748-a6e0-8a9e7773b242 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:50.819764 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ba508a6-6c5f-4748-a6e0-8a9e7773b242 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:50.827731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0ba508a6-6c5f-4748-a6e0-8a9e7773b242 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.201666 Oct 27 14:12:50.828534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 504/887] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:50 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:50.834113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-597c0a9a-0cb6-4598-b6cd-7755b1f975fe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:50.834729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-597c0a9a-0cb6-4598-b6cd-7755b1f975fe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:50.841073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-597c0a9a-0cb6-4598-b6cd-7755b1f975fe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:50.841787 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-597c0a9a-0cb6-4598-b6cd-7755b1f975fe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:50.842565 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-597c0a9a-0cb6-4598-b6cd-7755b1f975fe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:50.843190 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-597c0a9a-0cb6-4598-b6cd-7755b1f975fe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:50.969305 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-597c0a9a-0cb6-4598-b6cd-7755b1f975fe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:50.977117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-597c0a9a-0cb6-4598-b6cd-7755b1f975fe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.147359 Oct 27 14:12:50.977698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 505/888] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:50 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:50.982184 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-25a843e4-402b-43bd-ad0e-df045678a647 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:50.982817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-25a843e4-402b-43bd-ad0e-df045678a647 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:50.988451 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25a843e4-402b-43bd-ad0e-df045678a647 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:50.988902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25a843e4-402b-43bd-ad0e-df045678a647 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:50.989682 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25a843e4-402b-43bd-ad0e-df045678a647 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:50.990116 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-25a843e4-402b-43bd-ad0e-df045678a647 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:51.115525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-25a843e4-402b-43bd-ad0e-df045678a647 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:51.123159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-25a843e4-402b-43bd-ad0e-df045678a647 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.144308 Oct 27 14:12:51.123755 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 506/889] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:50 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:51.128026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-020e3a82-dfdb-428a-8231-359337db6c2d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:51.128620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-020e3a82-dfdb-428a-8231-359337db6c2d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:51.135387 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-020e3a82-dfdb-428a-8231-359337db6c2d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:51.135982 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-020e3a82-dfdb-428a-8231-359337db6c2d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:51.137002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-020e3a82-dfdb-428a-8231-359337db6c2d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:51.137405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-020e3a82-dfdb-428a-8231-359337db6c2d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:51.279201 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-020e3a82-dfdb-428a-8231-359337db6c2d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:51.291979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-020e3a82-dfdb-428a-8231-359337db6c2d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1761 microversion: 2.1 time: 0.167076 Oct 27 14:12:51.292719 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 507/890] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:51 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:51.298073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2f116ecb-2658-4121-a73d-e5817db23fd1 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:51.299260 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2f116ecb-2658-4121-a73d-e5817db23fd1 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] [instance: f40bbdf7-2daa-4c43-bb64-5d7e74d23348] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:51.317900 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2f116ecb-2658-4121-a73d-e5817db23fd1 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:51.318610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2f116ecb-2658-4121-a73d-e5817db23fd1 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:51.320269 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2f116ecb-2658-4121-a73d-e5817db23fd1 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:51.321091 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2f116ecb-2658-4121-a73d-e5817db23fd1 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:51.338860 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-2f116ecb-2658-4121-a73d-e5817db23fd1 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] HTTP exception thrown: Instance f40bbdf7-2daa-4c43-bb64-5d7e74d23348 could not be found. Oct 27 14:12:51.339566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2f116ecb-2658-4121-a73d-e5817db23fd1 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] Returning 404 to user: Instance f40bbdf7-2daa-4c43-bb64-5d7e74d23348 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:12:51.340463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2f116ecb-2658-4121-a73d-e5817db23fd1 tempest-VolumesSnapshotTestJSON-526338311 tempest-VolumesSnapshotTestJSON-526338311-project] 10.222.0.85 "GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348" status: 404 len: 111 microversion: 2.1 time: 0.046612 Oct 27 14:12:51.344279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 508/891] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:51 2021] GET /compute/v2.1/servers/f40bbdf7-2daa-4c43-bb64-5d7e74d23348 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:12:51.352698 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6a904970-dcd4-4911-8449-a837c517f656 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:51.354114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6a904970-dcd4-4911-8449-a837c517f656 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:51.362530 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6a904970-dcd4-4911-8449-a837c517f656 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:51.363194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6a904970-dcd4-4911-8449-a837c517f656 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:51.365265 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6a904970-dcd4-4911-8449-a837c517f656 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:51.365922 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6a904970-dcd4-4911-8449-a837c517f656 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:51.547992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6a904970-dcd4-4911-8449-a837c517f656 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:51.561356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6a904970-dcd4-4911-8449-a837c517f656 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:51.562870 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6a904970-dcd4-4911-8449-a837c517f656 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:51.564131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6a904970-dcd4-4911-8449-a837c517f656 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.222136 Oct 27 14:12:51.564680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 509/892] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:51 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:51.579566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-46ab7fb8-a8ab-4749-a388-29531713ae14 req-1eeb8048-a31b-4060-a075-57ac7b3d244b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e12ebd-fe44-4aa9-8f5e-572d91370319", "name": "network-vif-plugged", "status": "completed", "tag": "aab79689-5599-45f7-b77c-95b865b88b1d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:12:51.581370 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:12:51.581370 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:12:51.588648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-46ab7fb8-a8ab-4749-a388-29531713ae14 req-1eeb8048-a31b-4060-a075-57ac7b3d244b service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:51.589094 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-46ab7fb8-a8ab-4749-a388-29531713ae14 req-1eeb8048-a31b-4060-a075-57ac7b3d244b service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:51.601676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-46ab7fb8-a8ab-4749-a388-29531713ae14 req-1eeb8048-a31b-4060-a075-57ac7b3d244b service nova] Creating event network-vif-plugged:aab79689-5599-45f7-b77c-95b865b88b1d for instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 on hv-cinder-81566 Oct 27 14:12:51.607861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-46ab7fb8-a8ab-4749-a388-29531713ae14 req-1eeb8048-a31b-4060-a075-57ac7b3d244b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041076 Oct 27 14:12:51.608834 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 510/893] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:12:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:12:51.846754 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f1e80bc9-b1c0-475b-aaba-a8f12f6fed5f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:51.847433 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f1e80bc9-b1c0-475b-aaba-a8f12f6fed5f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:51.853555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1e80bc9-b1c0-475b-aaba-a8f12f6fed5f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:51.854012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1e80bc9-b1c0-475b-aaba-a8f12f6fed5f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:51.854786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1e80bc9-b1c0-475b-aaba-a8f12f6fed5f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:51.855259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f1e80bc9-b1c0-475b-aaba-a8f12f6fed5f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:52.044683 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f1e80bc9-b1c0-475b-aaba-a8f12f6fed5f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:52.054626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f1e80bc9-b1c0-475b-aaba-a8f12f6fed5f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.212448 Oct 27 14:12:52.055491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 511/894] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:51 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:52.070898 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-973b610e-22ca-42bc-acc7-cfd0a61a1efe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:52.071551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-973b610e-22ca-42bc-acc7-cfd0a61a1efe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:52.078848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-973b610e-22ca-42bc-acc7-cfd0a61a1efe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:52.079459 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-973b610e-22ca-42bc-acc7-cfd0a61a1efe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:52.080847 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-973b610e-22ca-42bc-acc7-cfd0a61a1efe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:52.081646 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-973b610e-22ca-42bc-acc7-cfd0a61a1efe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:52.361177 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-973b610e-22ca-42bc-acc7-cfd0a61a1efe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9da1f8decfb14aaaa69e6592ec5630a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165e7dc8a9245e9a982ffcabc980675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:52.368968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-973b610e-22ca-42bc-acc7-cfd0a61a1efe tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 200 len: 1521 microversion: 2.1 time: 0.303052 Oct 27 14:12:52.370006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 512/895] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:52 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:52.374510 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ad2736a7-97c1-48ec-b318-bfe8890af0c8 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:52.375260 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ad2736a7-97c1-48ec-b318-bfe8890af0c8 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:52.382165 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ad2736a7-97c1-48ec-b318-bfe8890af0c8 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:52.382576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ad2736a7-97c1-48ec-b318-bfe8890af0c8 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:52.383460 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ad2736a7-97c1-48ec-b318-bfe8890af0c8 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:52.383894 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ad2736a7-97c1-48ec-b318-bfe8890af0c8 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:52.576121 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ad2736a7-97c1-48ec-b318-bfe8890af0c8 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:52.585397 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ad2736a7-97c1-48ec-b318-bfe8890af0c8 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.214257 Oct 27 14:12:52.586507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 513/896] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:52 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:52.590703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-afbdb957-fdc2-430f-b65e-2d02c135d7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:52.591351 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-afbdb957-fdc2-430f-b65e-2d02c135d7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:52.597189 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-afbdb957-fdc2-430f-b65e-2d02c135d7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:52.597630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-afbdb957-fdc2-430f-b65e-2d02c135d7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:52.598609 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-afbdb957-fdc2-430f-b65e-2d02c135d7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:52.599047 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-afbdb957-fdc2-430f-b65e-2d02c135d7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:52.757604 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-afbdb957-fdc2-430f-b65e-2d02c135d7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:52.767214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-afbdb957-fdc2-430f-b65e-2d02c135d7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:52.768744 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-afbdb957-fdc2-430f-b65e-2d02c135d7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:52.771339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-afbdb957-fdc2-430f-b65e-2d02c135d7c9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.183701 Oct 27 14:12:52.772843 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 514/897] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:52 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:53.070784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6310a83a-c1ba-4f65-9f72-19bdbac23c59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:53.071619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6310a83a-c1ba-4f65-9f72-19bdbac23c59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:53.077934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6310a83a-c1ba-4f65-9f72-19bdbac23c59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:53.078385 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6310a83a-c1ba-4f65-9f72-19bdbac23c59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:53.079183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6310a83a-c1ba-4f65-9f72-19bdbac23c59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:53.079627 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6310a83a-c1ba-4f65-9f72-19bdbac23c59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:53.210827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6310a83a-c1ba-4f65-9f72-19bdbac23c59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:53.219809 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6310a83a-c1ba-4f65-9f72-19bdbac23c59 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.152845 Oct 27 14:12:53.220560 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 515/898] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:53 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:53.386173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b7b54fdf-0259-4ac0-a82e-0dc3a757b235 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:53.387117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b7b54fdf-0259-4ac0-a82e-0dc3a757b235 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] [instance: adbc567f-bc87-48cd-b910-ba46c84f914d] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:53.392969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b7b54fdf-0259-4ac0-a82e-0dc3a757b235 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:53.393408 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b7b54fdf-0259-4ac0-a82e-0dc3a757b235 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:53.394160 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b7b54fdf-0259-4ac0-a82e-0dc3a757b235 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:53.395093 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b7b54fdf-0259-4ac0-a82e-0dc3a757b235 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:53.407795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-b7b54fdf-0259-4ac0-a82e-0dc3a757b235 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] HTTP exception thrown: Instance adbc567f-bc87-48cd-b910-ba46c84f914d could not be found. Oct 27 14:12:53.408373 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b7b54fdf-0259-4ac0-a82e-0dc3a757b235 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] Returning 404 to user: Instance adbc567f-bc87-48cd-b910-ba46c84f914d could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:12:53.409167 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b7b54fdf-0259-4ac0-a82e-0dc3a757b235 tempest-ServerRescueNegativeTestJSON-342089914 tempest-ServerRescueNegativeTestJSON-342089914-project] 10.222.0.85 "GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d" status: 404 len: 111 microversion: 2.1 time: 0.026725 Oct 27 14:12:53.409686 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 516/899] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:53 2021] GET /compute/v2.1/servers/adbc567f-bc87-48cd-b910-ba46c84f914d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:12:53.602129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-346fe3e6-f498-4b50-984a-e7d18c6b8ae6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:53.602853 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-346fe3e6-f498-4b50-984a-e7d18c6b8ae6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:53.608751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-346fe3e6-f498-4b50-984a-e7d18c6b8ae6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:53.609287 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-346fe3e6-f498-4b50-984a-e7d18c6b8ae6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:53.610145 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-346fe3e6-f498-4b50-984a-e7d18c6b8ae6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:53.610683 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-346fe3e6-f498-4b50-984a-e7d18c6b8ae6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:53.811643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-346fe3e6-f498-4b50-984a-e7d18c6b8ae6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:53.819558 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-346fe3e6-f498-4b50-984a-e7d18c6b8ae6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.221636 Oct 27 14:12:53.820129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 517/900] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:53 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:53.824401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a27600d7-a3f5-4651-8ab0-f01a6e02723a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:53.824997 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a27600d7-a3f5-4651-8ab0-f01a6e02723a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:53.830613 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a27600d7-a3f5-4651-8ab0-f01a6e02723a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:53.831066 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a27600d7-a3f5-4651-8ab0-f01a6e02723a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:53.831902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a27600d7-a3f5-4651-8ab0-f01a6e02723a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:53.833028 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a27600d7-a3f5-4651-8ab0-f01a6e02723a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:54.050250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a27600d7-a3f5-4651-8ab0-f01a6e02723a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:54.059490 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a27600d7-a3f5-4651-8ab0-f01a6e02723a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:54.060987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a27600d7-a3f5-4651-8ab0-f01a6e02723a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:54.062141 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a27600d7-a3f5-4651-8ab0-f01a6e02723a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.241107 Oct 27 14:12:54.062997 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 518/901] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:53 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:54.238024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4fef35bf-7cc2-4392-a237-944385aadf96 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:54.239665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4fef35bf-7cc2-4392-a237-944385aadf96 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:54.245679 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fef35bf-7cc2-4392-a237-944385aadf96 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:54.246127 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fef35bf-7cc2-4392-a237-944385aadf96 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:54.246906 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fef35bf-7cc2-4392-a237-944385aadf96 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:54.247380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fef35bf-7cc2-4392-a237-944385aadf96 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:54.692162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4fef35bf-7cc2-4392-a237-944385aadf96 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:54.700130 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4fef35bf-7cc2-4392-a237-944385aadf96 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.465777 Oct 27 14:12:54.700713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 519/902] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:54 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:54.837185 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-13a14e05-05ba-4e30-b33c-9b73a0120e12 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:54.838356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-13a14e05-05ba-4e30-b33c-9b73a0120e12 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:54.844164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-13a14e05-05ba-4e30-b33c-9b73a0120e12 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:54.844614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-13a14e05-05ba-4e30-b33c-9b73a0120e12 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:54.845389 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-13a14e05-05ba-4e30-b33c-9b73a0120e12 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:54.845820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-13a14e05-05ba-4e30-b33c-9b73a0120e12 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:55.089436 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-13a14e05-05ba-4e30-b33c-9b73a0120e12 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:55.096910 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-13a14e05-05ba-4e30-b33c-9b73a0120e12 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.263503 Oct 27 14:12:55.097483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 520/903] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:54 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:55.110420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-87408b8c-86f7-4d6b-bc64-3f96ea4f0360 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:55.111015 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-87408b8c-86f7-4d6b-bc64-3f96ea4f0360 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:55.117607 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87408b8c-86f7-4d6b-bc64-3f96ea4f0360 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:55.118051 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87408b8c-86f7-4d6b-bc64-3f96ea4f0360 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:55.118813 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87408b8c-86f7-4d6b-bc64-3f96ea4f0360 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:55.119295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87408b8c-86f7-4d6b-bc64-3f96ea4f0360 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:55.337499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-87408b8c-86f7-4d6b-bc64-3f96ea4f0360 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:55.346048 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-87408b8c-86f7-4d6b-bc64-3f96ea4f0360 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:55.347518 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-87408b8c-86f7-4d6b-bc64-3f96ea4f0360 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:55.349215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-87408b8c-86f7-4d6b-bc64-3f96ea4f0360 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.242309 Oct 27 14:12:55.349775 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 521/904] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:55 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:55.719941 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-09f93a81-a15a-496f-9add-5c800683321f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:55.721355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-09f93a81-a15a-496f-9add-5c800683321f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:55.728682 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-09f93a81-a15a-496f-9add-5c800683321f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:55.729388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-09f93a81-a15a-496f-9add-5c800683321f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:55.730175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-09f93a81-a15a-496f-9add-5c800683321f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:55.730596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-09f93a81-a15a-496f-9add-5c800683321f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:55.933241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-09f93a81-a15a-496f-9add-5c800683321f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:55.942226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-09f93a81-a15a-496f-9add-5c800683321f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.227256 Oct 27 14:12:55.942909 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 522/905] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:55 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:56.114228 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5e5327c6-be86-4d0c-b446-0a5f824fc166 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:56.115610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5e5327c6-be86-4d0c-b446-0a5f824fc166 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:56.124381 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e5327c6-be86-4d0c-b446-0a5f824fc166 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:56.124966 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e5327c6-be86-4d0c-b446-0a5f824fc166 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:56.128127 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e5327c6-be86-4d0c-b446-0a5f824fc166 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:56.128884 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e5327c6-be86-4d0c-b446-0a5f824fc166 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:56.595416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5e5327c6-be86-4d0c-b446-0a5f824fc166 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:56.605404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5e5327c6-be86-4d0c-b446-0a5f824fc166 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.495390 Oct 27 14:12:56.606889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 523/906] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:56 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:56.615832 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c9d9edf3-685f-480c-8e65-08c1c5e6b4cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:56.615832 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c9d9edf3-685f-480c-8e65-08c1c5e6b4cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:56.632983 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c9d9edf3-685f-480c-8e65-08c1c5e6b4cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:56.633453 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c9d9edf3-685f-480c-8e65-08c1c5e6b4cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:56.634237 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c9d9edf3-685f-480c-8e65-08c1c5e6b4cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:56.634676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c9d9edf3-685f-480c-8e65-08c1c5e6b4cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:56.853893 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c9d9edf3-685f-480c-8e65-08c1c5e6b4cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:56.862406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c9d9edf3-685f-480c-8e65-08c1c5e6b4cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:56.864032 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c9d9edf3-685f-480c-8e65-08c1c5e6b4cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:56.865336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c9d9edf3-685f-480c-8e65-08c1c5e6b4cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1809 microversion: 2.20 time: 0.257438 Oct 27 14:12:56.865967 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 524/907] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:56 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:12:56.959578 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e06942f7-b4e0-4251-a053-d3e1d3429699 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:56.960287 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e06942f7-b4e0-4251-a053-d3e1d3429699 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:56.967687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e06942f7-b4e0-4251-a053-d3e1d3429699 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:56.968264 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e06942f7-b4e0-4251-a053-d3e1d3429699 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:56.969086 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e06942f7-b4e0-4251-a053-d3e1d3429699 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:56.969520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e06942f7-b4e0-4251-a053-d3e1d3429699 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:57.125770 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e06942f7-b4e0-4251-a053-d3e1d3429699 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:57.135937 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e06942f7-b4e0-4251-a053-d3e1d3429699 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.180914 Oct 27 14:12:57.136707 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 525/908] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:56 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:57.623217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ae4651f3-8e1a-4690-9653-d8b3f38e3fcb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:57.624134 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ae4651f3-8e1a-4690-9653-d8b3f38e3fcb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:57.630397 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ae4651f3-8e1a-4690-9653-d8b3f38e3fcb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:57.630904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ae4651f3-8e1a-4690-9653-d8b3f38e3fcb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:57.631748 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ae4651f3-8e1a-4690-9653-d8b3f38e3fcb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:57.632187 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ae4651f3-8e1a-4690-9653-d8b3f38e3fcb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:57.787621 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ae4651f3-8e1a-4690-9653-d8b3f38e3fcb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:57.796290 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ae4651f3-8e1a-4690-9653-d8b3f38e3fcb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.176698 Oct 27 14:12:57.797220 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 526/909] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:57 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:12:57.886648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bf8f649c-70e3-45d2-80e9-e76972ebf324 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:57.887837 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-bf8f649c-70e3-45d2-80e9-e76972ebf324 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:57.895184 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bf8f649c-70e3-45d2-80e9-e76972ebf324 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:57.895695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bf8f649c-70e3-45d2-80e9-e76972ebf324 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:57.896504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bf8f649c-70e3-45d2-80e9-e76972ebf324 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:57.897176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bf8f649c-70e3-45d2-80e9-e76972ebf324 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:58.045312 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bf8f649c-70e3-45d2-80e9-e76972ebf324 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:58.054931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bf8f649c-70e3-45d2-80e9-e76972ebf324 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:58.056572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bf8f649c-70e3-45d2-80e9-e76972ebf324 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:58.057913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bf8f649c-70e3-45d2-80e9-e76972ebf324 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1796 microversion: 2.20 time: 0.175540 Oct 27 14:12:58.058649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 527/910] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:12:57 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1796 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:12:58.153771 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4f2417ad-d96b-456a-b86d-8d1e284d479e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:58.154477 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4f2417ad-d96b-456a-b86d-8d1e284d479e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:58.165426 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f2417ad-d96b-456a-b86d-8d1e284d479e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:58.166083 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f2417ad-d96b-456a-b86d-8d1e284d479e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:58.166938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f2417ad-d96b-456a-b86d-8d1e284d479e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:58.167521 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f2417ad-d96b-456a-b86d-8d1e284d479e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:58.315315 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4f2417ad-d96b-456a-b86d-8d1e284d479e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:58.324353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4f2417ad-d96b-456a-b86d-8d1e284d479e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.174409 Oct 27 14:12:58.324931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 528/911] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:58 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:58.813817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f44c2e8f-2819-4aa3-9fee-5ab552a4b6fb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:58.814501 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f44c2e8f-2819-4aa3-9fee-5ab552a4b6fb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:58.821319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f44c2e8f-2819-4aa3-9fee-5ab552a4b6fb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:58.822129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f44c2e8f-2819-4aa3-9fee-5ab552a4b6fb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:58.823177 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f44c2e8f-2819-4aa3-9fee-5ab552a4b6fb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:58.823477 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f44c2e8f-2819-4aa3-9fee-5ab552a4b6fb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:58.969571 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f44c2e8f-2819-4aa3-9fee-5ab552a4b6fb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:58.980462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f44c2e8f-2819-4aa3-9fee-5ab552a4b6fb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.170508 Oct 27 14:12:58.981113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 529/912] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:58 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:12:59.344656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4ebc036e-a719-4cd0-9a8a-763cac50f01f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:12:59.346080 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4ebc036e-a719-4cd0-9a8a-763cac50f01f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:12:59.356266 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4ebc036e-a719-4cd0-9a8a-763cac50f01f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:59.357052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4ebc036e-a719-4cd0-9a8a-763cac50f01f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:59.358131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4ebc036e-a719-4cd0-9a8a-763cac50f01f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:12:59.359522 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4ebc036e-a719-4cd0-9a8a-763cac50f01f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:12:59.516923 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4ebc036e-a719-4cd0-9a8a-763cac50f01f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:12:59.525141 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4ebc036e-a719-4cd0-9a8a-763cac50f01f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.187107 Oct 27 14:12:59.526161 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 530/913] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:59 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:00.008405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-da732885-36a7-4c8e-9e2d-9940493eecae tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:00.009074 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-da732885-36a7-4c8e-9e2d-9940493eecae tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:00.016341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da732885-36a7-4c8e-9e2d-9940493eecae tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:00.017008 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da732885-36a7-4c8e-9e2d-9940493eecae tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:00.017673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da732885-36a7-4c8e-9e2d-9940493eecae tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:00.018102 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da732885-36a7-4c8e-9e2d-9940493eecae tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:00.154449 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-da732885-36a7-4c8e-9e2d-9940493eecae tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:00.163122 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-da732885-36a7-4c8e-9e2d-9940493eecae tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.165614 Oct 27 14:13:00.163725 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 531/914] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:12:59 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:00.542776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-94311afc-df83-4257-940a-0ce57597dbfe tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:00.543412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-94311afc-df83-4257-940a-0ce57597dbfe tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:00.549717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94311afc-df83-4257-940a-0ce57597dbfe tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:00.550173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94311afc-df83-4257-940a-0ce57597dbfe tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:00.551005 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94311afc-df83-4257-940a-0ce57597dbfe tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:00.551908 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-94311afc-df83-4257-940a-0ce57597dbfe tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:00.680655 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-94311afc-df83-4257-940a-0ce57597dbfe tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:00.688129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-94311afc-df83-4257-940a-0ce57597dbfe tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.149079 Oct 27 14:13:00.688699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 532/915] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:00 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:01.180499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1a58c0be-737c-4c1b-94ca-8defe44fa19f tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:01.181192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1a58c0be-737c-4c1b-94ca-8defe44fa19f tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:01.187013 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1a58c0be-737c-4c1b-94ca-8defe44fa19f tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:01.187648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1a58c0be-737c-4c1b-94ca-8defe44fa19f tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:01.188429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1a58c0be-737c-4c1b-94ca-8defe44fa19f tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:01.188861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1a58c0be-737c-4c1b-94ca-8defe44fa19f tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:01.329784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1a58c0be-737c-4c1b-94ca-8defe44fa19f tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:01.337545 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1a58c0be-737c-4c1b-94ca-8defe44fa19f tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.161488 Oct 27 14:13:01.338127 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 533/916] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:01 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:01.705863 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cfdd32df-8286-4499-906b-d62ed106bb9e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:01.706469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cfdd32df-8286-4499-906b-d62ed106bb9e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:01.712910 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cfdd32df-8286-4499-906b-d62ed106bb9e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:01.713355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cfdd32df-8286-4499-906b-d62ed106bb9e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:01.714126 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cfdd32df-8286-4499-906b-d62ed106bb9e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:01.714554 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cfdd32df-8286-4499-906b-d62ed106bb9e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:02.272309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-cfdd32df-8286-4499-906b-d62ed106bb9e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:02.280568 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cfdd32df-8286-4499-906b-d62ed106bb9e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.578383 Oct 27 14:13:02.282115 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 534/917] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:01 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:02.354208 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-14e9d98e-ebfe-4018-88ab-7e9baa741a6b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:02.354816 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-14e9d98e-ebfe-4018-88ab-7e9baa741a6b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:02.360511 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-14e9d98e-ebfe-4018-88ab-7e9baa741a6b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:02.360991 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-14e9d98e-ebfe-4018-88ab-7e9baa741a6b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:02.361763 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-14e9d98e-ebfe-4018-88ab-7e9baa741a6b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:02.362194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-14e9d98e-ebfe-4018-88ab-7e9baa741a6b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:02.519405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-14e9d98e-ebfe-4018-88ab-7e9baa741a6b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:02.527473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-14e9d98e-ebfe-4018-88ab-7e9baa741a6b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.177054 Oct 27 14:13:02.528054 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 535/918] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:02 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:03.300620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fcf59935-d3f5-4c5a-a638-f08cde5235ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:03.302105 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fcf59935-d3f5-4c5a-a638-f08cde5235ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:03.308861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fcf59935-d3f5-4c5a-a638-f08cde5235ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:03.309214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fcf59935-d3f5-4c5a-a638-f08cde5235ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:03.310177 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fcf59935-d3f5-4c5a-a638-f08cde5235ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:03.310760 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fcf59935-d3f5-4c5a-a638-f08cde5235ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:03.446236 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fcf59935-d3f5-4c5a-a638-f08cde5235ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:03.455194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fcf59935-d3f5-4c5a-a638-f08cde5235ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.159531 Oct 27 14:13:03.456585 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 536/919] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:03 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:03.549482 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-32c05482-125d-418f-b0b4-22a31d85e6f7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:03.550354 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-32c05482-125d-418f-b0b4-22a31d85e6f7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:03.562810 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-32c05482-125d-418f-b0b4-22a31d85e6f7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:03.565024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-32c05482-125d-418f-b0b4-22a31d85e6f7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:03.566219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-32c05482-125d-418f-b0b4-22a31d85e6f7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:03.567465 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-32c05482-125d-418f-b0b4-22a31d85e6f7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:03.744203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-32c05482-125d-418f-b0b4-22a31d85e6f7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:03.752268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-32c05482-125d-418f-b0b4-22a31d85e6f7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.208755 Oct 27 14:13:03.752847 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 537/920] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:03 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:04.478252 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0ca94893-85fc-4cef-a133-86834254cb7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:04.478909 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0ca94893-85fc-4cef-a133-86834254cb7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:04.485529 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ca94893-85fc-4cef-a133-86834254cb7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:04.486044 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ca94893-85fc-4cef-a133-86834254cb7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:04.486985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ca94893-85fc-4cef-a133-86834254cb7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:04.487536 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0ca94893-85fc-4cef-a133-86834254cb7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:04.615264 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0ca94893-85fc-4cef-a133-86834254cb7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:04.622495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0ca94893-85fc-4cef-a133-86834254cb7c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.148317 Oct 27 14:13:04.623053 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 538/921] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:04 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:04.770333 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4186068b-75dc-4a41-a84b-692b8b1f11db tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:04.770942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4186068b-75dc-4a41-a84b-692b8b1f11db tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:04.776907 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4186068b-75dc-4a41-a84b-692b8b1f11db tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:04.777361 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4186068b-75dc-4a41-a84b-692b8b1f11db tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:04.778129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4186068b-75dc-4a41-a84b-692b8b1f11db tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:04.778566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4186068b-75dc-4a41-a84b-692b8b1f11db tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:04.899004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4186068b-75dc-4a41-a84b-692b8b1f11db tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:04.906401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4186068b-75dc-4a41-a84b-692b8b1f11db tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.139806 Oct 27 14:13:04.906964 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 539/922] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:04 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:05.325789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-88fda652-5877-49b6-9fd8-3978b0bcf1ce req-eed50e5e-4272-4362-8205-7dc023fff0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb7ac2c-4e45-46c4-8b56-062aac14258b", "name": "network-vif-plugged", "status": "completed", "tag": "e5f6c633-3fb1-4c33-8bba-2b47432ace5a"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:13:05.327709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:13:05.327709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:13:05.334876 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-88fda652-5877-49b6-9fd8-3978b0bcf1ce req-eed50e5e-4272-4362-8205-7dc023fff0ca service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:05.335375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-88fda652-5877-49b6-9fd8-3978b0bcf1ce req-eed50e5e-4272-4362-8205-7dc023fff0ca service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:05.348780 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-88fda652-5877-49b6-9fd8-3978b0bcf1ce req-eed50e5e-4272-4362-8205-7dc023fff0ca service nova] Creating event network-vif-plugged:e5f6c633-3fb1-4c33-8bba-2b47432ace5a for instance 0cb7ac2c-4e45-46c4-8b56-062aac14258b on hv-cinder-81566 Oct 27 14:13:05.353973 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-88fda652-5877-49b6-9fd8-3978b0bcf1ce req-eed50e5e-4272-4362-8205-7dc023fff0ca service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032416 Oct 27 14:13:05.354918 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 540/923] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:13:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:13:05.641681 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b162a562-7f20-4221-a2a4-2ad497f0c680 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:05.642355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b162a562-7f20-4221-a2a4-2ad497f0c680 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:05.649779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b162a562-7f20-4221-a2a4-2ad497f0c680 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:05.650430 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b162a562-7f20-4221-a2a4-2ad497f0c680 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:05.651489 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b162a562-7f20-4221-a2a4-2ad497f0c680 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:05.652503 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b162a562-7f20-4221-a2a4-2ad497f0c680 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:05.786693 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b162a562-7f20-4221-a2a4-2ad497f0c680 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:05.805021 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b162a562-7f20-4221-a2a4-2ad497f0c680 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.168038 Oct 27 14:13:05.805629 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 541/924] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:05 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:05.922296 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cbfff76e-aa1a-4d7e-8bdf-40b3e65d75c0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:05.923115 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cbfff76e-aa1a-4d7e-8bdf-40b3e65d75c0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:05.933062 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbfff76e-aa1a-4d7e-8bdf-40b3e65d75c0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:05.933601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbfff76e-aa1a-4d7e-8bdf-40b3e65d75c0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:05.934457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbfff76e-aa1a-4d7e-8bdf-40b3e65d75c0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:05.935037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbfff76e-aa1a-4d7e-8bdf-40b3e65d75c0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:06.072285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-cbfff76e-aa1a-4d7e-8bdf-40b3e65d75c0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:06.083626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cbfff76e-aa1a-4d7e-8bdf-40b3e65d75c0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.161627 Oct 27 14:13:06.083626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 542/925] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:05 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:06.822784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f66f093f-999f-46ad-98e0-dc75bf89649d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:06.823408 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f66f093f-999f-46ad-98e0-dc75bf89649d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:06.829911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f66f093f-999f-46ad-98e0-dc75bf89649d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:06.830358 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f66f093f-999f-46ad-98e0-dc75bf89649d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:06.831116 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f66f093f-999f-46ad-98e0-dc75bf89649d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:06.831570 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f66f093f-999f-46ad-98e0-dc75bf89649d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:07.122306 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f66f093f-999f-46ad-98e0-dc75bf89649d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:07.130028 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f66f093f-999f-46ad-98e0-dc75bf89649d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.310931 Oct 27 14:13:07.130595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 543/926] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:06 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:07.134869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-795b7aae-102b-423c-98c9-b4e9d10ceacc tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:07.135500 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-795b7aae-102b-423c-98c9-b4e9d10ceacc tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:07.141590 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-795b7aae-102b-423c-98c9-b4e9d10ceacc tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:07.142034 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-795b7aae-102b-423c-98c9-b4e9d10ceacc tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:07.142798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-795b7aae-102b-423c-98c9-b4e9d10ceacc tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:07.143379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-795b7aae-102b-423c-98c9-b4e9d10ceacc tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:07.267668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-795b7aae-102b-423c-98c9-b4e9d10ceacc tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:07.275752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-795b7aae-102b-423c-98c9-b4e9d10ceacc tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.144200 Oct 27 14:13:07.276355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 544/927] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:07 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:08.147532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-18cfd1aa-b82b-4c18-850d-11d19f29a761 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:08.148161 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-18cfd1aa-b82b-4c18-850d-11d19f29a761 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:08.154547 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18cfd1aa-b82b-4c18-850d-11d19f29a761 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:08.154998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18cfd1aa-b82b-4c18-850d-11d19f29a761 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:08.155811 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18cfd1aa-b82b-4c18-850d-11d19f29a761 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:08.156250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-18cfd1aa-b82b-4c18-850d-11d19f29a761 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:08.286340 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-18cfd1aa-b82b-4c18-850d-11d19f29a761 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:08.293822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-18cfd1aa-b82b-4c18-850d-11d19f29a761 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1677 microversion: 2.1 time: 0.150090 Oct 27 14:13:08.294410 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 545/928] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:08 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:08.298582 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0b4a18d4-4cc2-41ad-9ccc-9595f4d0b1d6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:08.299201 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0b4a18d4-4cc2-41ad-9ccc-9595f4d0b1d6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:08.304631 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b4a18d4-4cc2-41ad-9ccc-9595f4d0b1d6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:08.305073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b4a18d4-4cc2-41ad-9ccc-9595f4d0b1d6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:08.305852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b4a18d4-4cc2-41ad-9ccc-9595f4d0b1d6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:08.306268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0b4a18d4-4cc2-41ad-9ccc-9595f4d0b1d6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:08.436687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0b4a18d4-4cc2-41ad-9ccc-9595f4d0b1d6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:08.444970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0b4a18d4-4cc2-41ad-9ccc-9595f4d0b1d6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1260 microversion: 2.1 time: 0.149617 Oct 27 14:13:08.445525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 546/929] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:08 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:09.312130 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f3bc9be3-a9df-49c7-9283-fa3b4bc69a53 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:09.312771 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f3bc9be3-a9df-49c7-9283-fa3b4bc69a53 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:09.321843 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f3bc9be3-a9df-49c7-9283-fa3b4bc69a53 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:09.322300 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f3bc9be3-a9df-49c7-9283-fa3b4bc69a53 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:09.323639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f3bc9be3-a9df-49c7-9283-fa3b4bc69a53 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:09.323639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f3bc9be3-a9df-49c7-9283-fa3b4bc69a53 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:09.483042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f3bc9be3-a9df-49c7-9283-fa3b4bc69a53 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:09.492509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f3bc9be3-a9df-49c7-9283-fa3b4bc69a53 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1654 microversion: 2.1 time: 0.184903 Oct 27 14:13:09.493089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 547/930] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:09 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1654 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:09.497416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a6044b5e-88c2-4e90-af93-289bb4191077 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:09.498123 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a6044b5e-88c2-4e90-af93-289bb4191077 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:09.504611 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a6044b5e-88c2-4e90-af93-289bb4191077 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:09.505138 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a6044b5e-88c2-4e90-af93-289bb4191077 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:09.505921 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a6044b5e-88c2-4e90-af93-289bb4191077 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:09.506358 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a6044b5e-88c2-4e90-af93-289bb4191077 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:09.630667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a6044b5e-88c2-4e90-af93-289bb4191077 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:09.639051 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a6044b5e-88c2-4e90-af93-289bb4191077 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1444 microversion: 2.1 time: 0.144996 Oct 27 14:13:09.639654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 548/931] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:09 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:09.644544 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-51702c93-3b85-495c-8e82-249feeb0a64d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:13:09.650597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-51702c93-3b85-495c-8e82-249feeb0a64d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:09.651210 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-51702c93-3b85-495c-8e82-249feeb0a64d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:09.678166 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-51702c93-3b85-495c-8e82-249feeb0a64d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Going to try to start instance {{(pid=115931) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 27 14:13:09.720965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-51702c93-3b85-495c-8e82-249feeb0a64d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action" status: 202 len: 0 microversion: 2.1 time: 0.080107 Oct 27 14:13:09.721565 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 549/932] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:13:09 2021] POST /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:13:09.726905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6e803f1b-a365-46ed-967a-c4c29cf41230 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:09.727631 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6e803f1b-a365-46ed-967a-c4c29cf41230 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:09.733707 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6e803f1b-a365-46ed-967a-c4c29cf41230 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:09.734162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6e803f1b-a365-46ed-967a-c4c29cf41230 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:09.734939 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6e803f1b-a365-46ed-967a-c4c29cf41230 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:09.735463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6e803f1b-a365-46ed-967a-c4c29cf41230 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:09.890007 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6e803f1b-a365-46ed-967a-c4c29cf41230 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:09.897657 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6e803f1b-a365-46ed-967a-c4c29cf41230 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1444 microversion: 2.1 time: 0.174871 Oct 27 14:13:09.898316 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 550/933] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:09 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1444 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:09.903308 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fc88b49a-4b5f-43d5-ac43-25ba077028f7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:09.904065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fc88b49a-4b5f-43d5-ac43-25ba077028f7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:09.912462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc88b49a-4b5f-43d5-ac43-25ba077028f7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:09.912910 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc88b49a-4b5f-43d5-ac43-25ba077028f7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:09.913699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc88b49a-4b5f-43d5-ac43-25ba077028f7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:09.914319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fc88b49a-4b5f-43d5-ac43-25ba077028f7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:10.121693 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fc88b49a-4b5f-43d5-ac43-25ba077028f7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:10.129242 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fc88b49a-4b5f-43d5-ac43-25ba077028f7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1663 microversion: 2.1 time: 0.229912 Oct 27 14:13:10.130087 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 551/934] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:09 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1663 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:11.148406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-548b624d-9bad-45ad-bb21-7c248acbede5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:11.149193 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-548b624d-9bad-45ad-bb21-7c248acbede5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:11.155489 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-548b624d-9bad-45ad-bb21-7c248acbede5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:11.155943 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-548b624d-9bad-45ad-bb21-7c248acbede5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:11.156723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-548b624d-9bad-45ad-bb21-7c248acbede5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:11.157160 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-548b624d-9bad-45ad-bb21-7c248acbede5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:11.292233 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-548b624d-9bad-45ad-bb21-7c248acbede5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:11.300566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-548b624d-9bad-45ad-bb21-7c248acbede5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1667 microversion: 2.1 time: 0.156442 Oct 27 14:13:11.301238 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 552/935] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:11 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:11.929192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-bd191fd8-8b3e-4d72-a144-5b33800933aa req-cc2b8c9b-f4b8-4667-a7d4-d98c7bc710d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb7ac2c-4e45-46c4-8b56-062aac14258b", "tag": "e5f6c633-3fb1-4c33-8bba-2b47432ace5a"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:13:11.929935 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:13:11.929935 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:13:11.937407 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-bd191fd8-8b3e-4d72-a144-5b33800933aa req-cc2b8c9b-f4b8-4667-a7d4-d98c7bc710d2 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:11.938022 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-bd191fd8-8b3e-4d72-a144-5b33800933aa req-cc2b8c9b-f4b8-4667-a7d4-d98c7bc710d2 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:11.951374 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-bd191fd8-8b3e-4d72-a144-5b33800933aa req-cc2b8c9b-f4b8-4667-a7d4-d98c7bc710d2 service nova] Creating event network-changed:e5f6c633-3fb1-4c33-8bba-2b47432ace5a for instance 0cb7ac2c-4e45-46c4-8b56-062aac14258b on hv-cinder-81566 Oct 27 14:13:11.957070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-bd191fd8-8b3e-4d72-a144-5b33800933aa req-cc2b8c9b-f4b8-4667-a7d4-d98c7bc710d2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033554 Oct 27 14:13:11.957700 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 553/936] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:13:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:13:18.883396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-88cbb682-b187-4fb6-91f6-9e8217e5010a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:13:18.884417 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-88cbb682-b187-4fb6-91f6-9e8217e5010a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:18.890758 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-88cbb682-b187-4fb6-91f6-9e8217e5010a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:18.891236 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-88cbb682-b187-4fb6-91f6-9e8217e5010a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:18.892007 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-88cbb682-b187-4fb6-91f6-9e8217e5010a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:18.892471 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-88cbb682-b187-4fb6-91f6-9e8217e5010a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:18.964996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-88cbb682-b187-4fb6-91f6-9e8217e5010a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "POST /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.086621 Oct 27 14:13:18.968621 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 554/937] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:13:18 2021] POST /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:13:18.974521 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-eb8908eb-3192-4ffe-b90b-4e3770e9c9c2 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:18.975245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-eb8908eb-3192-4ffe-b90b-4e3770e9c9c2 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:18.983079 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb8908eb-3192-4ffe-b90b-4e3770e9c9c2 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:18.983752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb8908eb-3192-4ffe-b90b-4e3770e9c9c2 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:18.984825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb8908eb-3192-4ffe-b90b-4e3770e9c9c2 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:18.985607 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eb8908eb-3192-4ffe-b90b-4e3770e9c9c2 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:19.194988 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-eb8908eb-3192-4ffe-b90b-4e3770e9c9c2 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:19.202982 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-eb8908eb-3192-4ffe-b90b-4e3770e9c9c2 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1753 microversion: 2.1 time: 0.233043 Oct 27 14:13:19.203734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 555/938] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:18 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1753 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:20.221477 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-444bf09e-4173-4017-ad6c-343294d04c18 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:20.222132 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-444bf09e-4173-4017-ad6c-343294d04c18 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:20.229573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-444bf09e-4173-4017-ad6c-343294d04c18 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:20.230035 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-444bf09e-4173-4017-ad6c-343294d04c18 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:20.230822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-444bf09e-4173-4017-ad6c-343294d04c18 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:20.231292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-444bf09e-4173-4017-ad6c-343294d04c18 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:20.433033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-444bf09e-4173-4017-ad6c-343294d04c18 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:20.441067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-444bf09e-4173-4017-ad6c-343294d04c18 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.223197 Oct 27 14:13:20.450454 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 556/939] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:20 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:21.460819 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2c9e6634-9692-411a-aa0c-89d4d06bf08e tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:21.461438 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2c9e6634-9692-411a-aa0c-89d4d06bf08e tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:21.468194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2c9e6634-9692-411a-aa0c-89d4d06bf08e tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:21.468646 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2c9e6634-9692-411a-aa0c-89d4d06bf08e tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:21.471859 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2c9e6634-9692-411a-aa0c-89d4d06bf08e tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:21.472368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2c9e6634-9692-411a-aa0c-89d4d06bf08e tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:21.601143 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2c9e6634-9692-411a-aa0c-89d4d06bf08e tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:21.609262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2c9e6634-9692-411a-aa0c-89d4d06bf08e tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.153106 Oct 27 14:13:21.609836 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 557/940] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:21 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:22.627351 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b37dde9f-7741-4c39-b8f8-053b96612b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:22.627987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b37dde9f-7741-4c39-b8f8-053b96612b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:22.635292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b37dde9f-7741-4c39-b8f8-053b96612b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:22.635742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b37dde9f-7741-4c39-b8f8-053b96612b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:22.636547 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b37dde9f-7741-4c39-b8f8-053b96612b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:22.636979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b37dde9f-7741-4c39-b8f8-053b96612b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:22.762403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b37dde9f-7741-4c39-b8f8-053b96612b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:22.771242 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b37dde9f-7741-4c39-b8f8-053b96612b50 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.146921 Oct 27 14:13:22.771818 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 558/941] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:22 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:23.789042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f395ffb1-9274-4968-a442-ae91c32e546b tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:23.789711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f395ffb1-9274-4968-a442-ae91c32e546b tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:23.795952 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f395ffb1-9274-4968-a442-ae91c32e546b tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:23.796414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f395ffb1-9274-4968-a442-ae91c32e546b tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:23.797162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f395ffb1-9274-4968-a442-ae91c32e546b tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:23.797593 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f395ffb1-9274-4968-a442-ae91c32e546b tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:23.934104 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f395ffb1-9274-4968-a442-ae91c32e546b tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:23.941793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f395ffb1-9274-4968-a442-ae91c32e546b tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.157265 Oct 27 14:13:23.942350 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 559/942] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:23 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:24.961204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9a5d7419-75ec-44e5-bec0-3a3ed899b734 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:24.961871 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9a5d7419-75ec-44e5-bec0-3a3ed899b734 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:24.968314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a5d7419-75ec-44e5-bec0-3a3ed899b734 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:24.968757 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a5d7419-75ec-44e5-bec0-3a3ed899b734 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:24.969524 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a5d7419-75ec-44e5-bec0-3a3ed899b734 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:24.969954 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a5d7419-75ec-44e5-bec0-3a3ed899b734 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:25.096902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9a5d7419-75ec-44e5-bec0-3a3ed899b734 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:25.105574 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9a5d7419-75ec-44e5-bec0-3a3ed899b734 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.148450 Oct 27 14:13:25.106235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 560/943] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:24 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:26.123048 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-aed6f605-c0a0-4235-a01e-0b0217b14ebd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:26.123723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-aed6f605-c0a0-4235-a01e-0b0217b14ebd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:26.129503 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aed6f605-c0a0-4235-a01e-0b0217b14ebd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:26.129949 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aed6f605-c0a0-4235-a01e-0b0217b14ebd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:26.130702 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aed6f605-c0a0-4235-a01e-0b0217b14ebd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:26.131309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aed6f605-c0a0-4235-a01e-0b0217b14ebd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:26.255339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-aed6f605-c0a0-4235-a01e-0b0217b14ebd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:26.263231 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-aed6f605-c0a0-4235-a01e-0b0217b14ebd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.143996 Oct 27 14:13:26.264065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 561/944] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:26 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:27.280993 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-975d4591-d9af-4b49-bd68-2945a7876cb4 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:27.281632 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-975d4591-d9af-4b49-bd68-2945a7876cb4 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:27.288456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-975d4591-d9af-4b49-bd68-2945a7876cb4 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:27.288908 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-975d4591-d9af-4b49-bd68-2945a7876cb4 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:27.289665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-975d4591-d9af-4b49-bd68-2945a7876cb4 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:27.290093 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-975d4591-d9af-4b49-bd68-2945a7876cb4 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:27.419353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-975d4591-d9af-4b49-bd68-2945a7876cb4 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:27.427065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-975d4591-d9af-4b49-bd68-2945a7876cb4 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.149749 Oct 27 14:13:27.427724 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 562/945] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:27 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:28.445250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dffe5a83-bbb6-4f4f-9bf7-7ed70e43a5d5 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:28.445925 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dffe5a83-bbb6-4f4f-9bf7-7ed70e43a5d5 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:28.452553 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dffe5a83-bbb6-4f4f-9bf7-7ed70e43a5d5 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:28.453063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dffe5a83-bbb6-4f4f-9bf7-7ed70e43a5d5 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:28.453992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dffe5a83-bbb6-4f4f-9bf7-7ed70e43a5d5 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:28.454491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dffe5a83-bbb6-4f4f-9bf7-7ed70e43a5d5 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:28.594471 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-dffe5a83-bbb6-4f4f-9bf7-7ed70e43a5d5 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:28.603988 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dffe5a83-bbb6-4f4f-9bf7-7ed70e43a5d5 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.162839 Oct 27 14:13:28.604643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 563/946] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:28 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:29.621647 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d16a40b5-4087-441f-be6e-e48884b01fad tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:29.622270 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d16a40b5-4087-441f-be6e-e48884b01fad tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:29.630445 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d16a40b5-4087-441f-be6e-e48884b01fad tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:29.631106 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d16a40b5-4087-441f-be6e-e48884b01fad tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:29.632108 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d16a40b5-4087-441f-be6e-e48884b01fad tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:29.633816 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d16a40b5-4087-441f-be6e-e48884b01fad tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:29.767160 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d16a40b5-4087-441f-be6e-e48884b01fad tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:29.776655 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d16a40b5-4087-441f-be6e-e48884b01fad tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.158610 Oct 27 14:13:29.777524 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 564/947] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:29 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:30.794200 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-711fff95-0f2f-4ce3-b42d-272701c9ba30 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:30.794858 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-711fff95-0f2f-4ce3-b42d-272701c9ba30 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:30.801414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-711fff95-0f2f-4ce3-b42d-272701c9ba30 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:30.801859 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-711fff95-0f2f-4ce3-b42d-272701c9ba30 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:30.802627 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-711fff95-0f2f-4ce3-b42d-272701c9ba30 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:30.803053 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-711fff95-0f2f-4ce3-b42d-272701c9ba30 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:30.946008 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-711fff95-0f2f-4ce3-b42d-272701c9ba30 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:30.954221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-711fff95-0f2f-4ce3-b42d-272701c9ba30 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.163560 Oct 27 14:13:30.965829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 565/948] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:30 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:31.971550 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8ccabd83-0bed-46e6-8158-1e4847c9cda3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:31.972162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8ccabd83-0bed-46e6-8158-1e4847c9cda3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:31.978650 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8ccabd83-0bed-46e6-8158-1e4847c9cda3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:31.979081 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8ccabd83-0bed-46e6-8158-1e4847c9cda3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:31.979951 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8ccabd83-0bed-46e6-8158-1e4847c9cda3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:31.980283 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8ccabd83-0bed-46e6-8158-1e4847c9cda3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:32.107304 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8ccabd83-0bed-46e6-8158-1e4847c9cda3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:32.115664 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8ccabd83-0bed-46e6-8158-1e4847c9cda3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.147706 Oct 27 14:13:32.116380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 566/949] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:31 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:33.133312 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c133a857-8715-4b5c-9972-6c808de5fb15 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:33.133966 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c133a857-8715-4b5c-9972-6c808de5fb15 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:33.140792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c133a857-8715-4b5c-9972-6c808de5fb15 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:33.141245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c133a857-8715-4b5c-9972-6c808de5fb15 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:33.142024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c133a857-8715-4b5c-9972-6c808de5fb15 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:33.142456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c133a857-8715-4b5c-9972-6c808de5fb15 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:33.271834 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c133a857-8715-4b5c-9972-6c808de5fb15 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:33.280595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c133a857-8715-4b5c-9972-6c808de5fb15 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.151472 Oct 27 14:13:33.281176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 567/950] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:33 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:34.297770 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-39cf4899-ee5d-4970-bd99-7752c3ce0e21 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:34.298393 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-39cf4899-ee5d-4970-bd99-7752c3ce0e21 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:34.305116 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39cf4899-ee5d-4970-bd99-7752c3ce0e21 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:34.305557 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39cf4899-ee5d-4970-bd99-7752c3ce0e21 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:34.306318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39cf4899-ee5d-4970-bd99-7752c3ce0e21 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:34.306751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39cf4899-ee5d-4970-bd99-7752c3ce0e21 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:34.430267 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-39cf4899-ee5d-4970-bd99-7752c3ce0e21 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:34.438209 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-39cf4899-ee5d-4970-bd99-7752c3ce0e21 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.144278 Oct 27 14:13:34.438845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 568/951] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:34 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:35.457361 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1ae3bb75-3b5f-488f-aea5-d682503b10eb tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:35.458132 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1ae3bb75-3b5f-488f-aea5-d682503b10eb tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:35.464577 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1ae3bb75-3b5f-488f-aea5-d682503b10eb tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:35.465121 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1ae3bb75-3b5f-488f-aea5-d682503b10eb tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:35.465806 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1ae3bb75-3b5f-488f-aea5-d682503b10eb tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:35.466240 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1ae3bb75-3b5f-488f-aea5-d682503b10eb tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:35.594134 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1ae3bb75-3b5f-488f-aea5-d682503b10eb tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:35.602646 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1ae3bb75-3b5f-488f-aea5-d682503b10eb tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.150686 Oct 27 14:13:35.603239 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 569/952] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:35 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:36.620255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6e07e870-b427-4660-b017-7a3e013d5141 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:36.620930 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6e07e870-b427-4660-b017-7a3e013d5141 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:36.627329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6e07e870-b427-4660-b017-7a3e013d5141 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:36.627778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6e07e870-b427-4660-b017-7a3e013d5141 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:36.628552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6e07e870-b427-4660-b017-7a3e013d5141 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:36.628985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6e07e870-b427-4660-b017-7a3e013d5141 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:36.770879 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6e07e870-b427-4660-b017-7a3e013d5141 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:36.781721 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6e07e870-b427-4660-b017-7a3e013d5141 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.165361 Oct 27 14:13:36.782826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 570/953] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:36 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:37.799604 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9f169f9a-4c65-449e-8661-c8e894ee1b79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:37.800227 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9f169f9a-4c65-449e-8661-c8e894ee1b79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:37.807287 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9f169f9a-4c65-449e-8661-c8e894ee1b79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:37.807772 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9f169f9a-4c65-449e-8661-c8e894ee1b79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:37.808563 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9f169f9a-4c65-449e-8661-c8e894ee1b79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:37.809001 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9f169f9a-4c65-449e-8661-c8e894ee1b79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:37.941792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9f169f9a-4c65-449e-8661-c8e894ee1b79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:37.949874 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9f169f9a-4c65-449e-8661-c8e894ee1b79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.153916 Oct 27 14:13:37.950559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 571/954] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:37 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:38.969848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-12dcf032-7412-45fa-8974-c83eba343751 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:38.970606 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-12dcf032-7412-45fa-8974-c83eba343751 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:38.978595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-12dcf032-7412-45fa-8974-c83eba343751 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:38.979042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-12dcf032-7412-45fa-8974-c83eba343751 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:38.980056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-12dcf032-7412-45fa-8974-c83eba343751 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:38.980540 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-12dcf032-7412-45fa-8974-c83eba343751 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:39.184488 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-12dcf032-7412-45fa-8974-c83eba343751 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:39.192832 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-12dcf032-7412-45fa-8974-c83eba343751 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.228873 Oct 27 14:13:39.193556 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 572/955] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:38 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:40.211444 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6bb57adc-9f6f-4be3-9225-d742699a7be3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:40.212113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6bb57adc-9f6f-4be3-9225-d742699a7be3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:40.220814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6bb57adc-9f6f-4be3-9225-d742699a7be3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:40.220814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6bb57adc-9f6f-4be3-9225-d742699a7be3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:40.220814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6bb57adc-9f6f-4be3-9225-d742699a7be3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:40.220814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6bb57adc-9f6f-4be3-9225-d742699a7be3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:40.352056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6bb57adc-9f6f-4be3-9225-d742699a7be3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:40.360032 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6bb57adc-9f6f-4be3-9225-d742699a7be3 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.153060 Oct 27 14:13:40.360599 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 573/956] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:40 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:41.377286 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b576e434-bb80-4aac-963f-5bc4d04c5283 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:41.377950 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b576e434-bb80-4aac-963f-5bc4d04c5283 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:41.384419 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b576e434-bb80-4aac-963f-5bc4d04c5283 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:41.384870 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b576e434-bb80-4aac-963f-5bc4d04c5283 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:41.385639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b576e434-bb80-4aac-963f-5bc4d04c5283 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:41.386073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b576e434-bb80-4aac-963f-5bc4d04c5283 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:41.510431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b576e434-bb80-4aac-963f-5bc4d04c5283 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:41.518475 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b576e434-bb80-4aac-963f-5bc4d04c5283 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.144907 Oct 27 14:13:41.519039 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 574/957] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:41 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:42.535891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-feab1b76-59d5-40d3-81f2-17d78216b371 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:42.536541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-feab1b76-59d5-40d3-81f2-17d78216b371 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:42.543063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-feab1b76-59d5-40d3-81f2-17d78216b371 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:42.543535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-feab1b76-59d5-40d3-81f2-17d78216b371 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:42.544290 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-feab1b76-59d5-40d3-81f2-17d78216b371 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:42.544715 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-feab1b76-59d5-40d3-81f2-17d78216b371 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:42.669845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-feab1b76-59d5-40d3-81f2-17d78216b371 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:42.677664 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-feab1b76-59d5-40d3-81f2-17d78216b371 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.145506 Oct 27 14:13:42.678235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 575/958] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:42 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:43.695783 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7c014797-ff2f-452e-a2ec-fc229e233218 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:43.696600 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7c014797-ff2f-452e-a2ec-fc229e233218 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:43.703181 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7c014797-ff2f-452e-a2ec-fc229e233218 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:43.703628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7c014797-ff2f-452e-a2ec-fc229e233218 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:43.704398 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7c014797-ff2f-452e-a2ec-fc229e233218 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:43.704829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7c014797-ff2f-452e-a2ec-fc229e233218 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:43.835507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7c014797-ff2f-452e-a2ec-fc229e233218 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:43.844452 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7c014797-ff2f-452e-a2ec-fc229e233218 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.152910 Oct 27 14:13:43.845030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 576/959] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:43 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:44.861194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-69804aec-b84e-4254-9206-aad5da06dd6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:44.861827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-69804aec-b84e-4254-9206-aad5da06dd6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:44.869033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69804aec-b84e-4254-9206-aad5da06dd6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:44.869484 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69804aec-b84e-4254-9206-aad5da06dd6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:44.870256 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69804aec-b84e-4254-9206-aad5da06dd6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:44.870687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-69804aec-b84e-4254-9206-aad5da06dd6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:44.994162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-69804aec-b84e-4254-9206-aad5da06dd6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:45.002476 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-69804aec-b84e-4254-9206-aad5da06dd6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.144993 Oct 27 14:13:45.003049 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 577/960] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:44 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:13:46.020146 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ef178b5a-38e3-472d-95b8-1dacddfe3b26 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:46.021494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ef178b5a-38e3-472d-95b8-1dacddfe3b26 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:46.027978 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef178b5a-38e3-472d-95b8-1dacddfe3b26 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:46.028412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef178b5a-38e3-472d-95b8-1dacddfe3b26 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:46.029220 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef178b5a-38e3-472d-95b8-1dacddfe3b26 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:46.029840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef178b5a-38e3-472d-95b8-1dacddfe3b26 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:46.161983 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ef178b5a-38e3-472d-95b8-1dacddfe3b26 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:46.170597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ef178b5a-38e3-472d-95b8-1dacddfe3b26 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1758 microversion: 2.1 time: 0.154095 Oct 27 14:13:46.171207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 578/961] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:46 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1758 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:47.187820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ad56a760-1603-4ef4-8371-2a9b408331bd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:47.188456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ad56a760-1603-4ef4-8371-2a9b408331bd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:47.194912 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ad56a760-1603-4ef4-8371-2a9b408331bd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:47.195695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ad56a760-1603-4ef4-8371-2a9b408331bd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:47.196481 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ad56a760-1603-4ef4-8371-2a9b408331bd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:47.196915 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ad56a760-1603-4ef4-8371-2a9b408331bd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:47.326168 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ad56a760-1603-4ef4-8371-2a9b408331bd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:47.334053 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ad56a760-1603-4ef4-8371-2a9b408331bd tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1761 microversion: 2.1 time: 0.149903 Oct 27 14:13:47.334704 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 579/962] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:13:47 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1761 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:57.217136 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-85e0be53-8e7a-4d5a-8f31-12bdc3cd7544 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:57.217795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-85e0be53-8e7a-4d5a-8f31-12bdc3cd7544 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:57.223508 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85e0be53-8e7a-4d5a-8f31-12bdc3cd7544 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:57.223958 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85e0be53-8e7a-4d5a-8f31-12bdc3cd7544 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:57.224729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85e0be53-8e7a-4d5a-8f31-12bdc3cd7544 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:57.225160 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85e0be53-8e7a-4d5a-8f31-12bdc3cd7544 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:57.255846 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-85e0be53-8e7a-4d5a-8f31-12bdc3cd7544 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments/8c55b207-608a-48b9-ae14-6c3ee3366f44" status: 200 len: 194 microversion: 2.20 time: 0.217646 Oct 27 14:13:57.256441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 580/963] 10.222.0.85 () {60 vars in 1453 bytes} [Wed Oct 27 14:13:57 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments/8c55b207-608a-48b9-ae14-6c3ee3366f44 => generated 194 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:13:57.316537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-edaeb3cb-0bb3-475c-af26-15062507a6d5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:57.317029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-edaeb3cb-0bb3-475c-af26-15062507a6d5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:57.322947 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-edaeb3cb-0bb3-475c-af26-15062507a6d5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:57.323606 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-edaeb3cb-0bb3-475c-af26-15062507a6d5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:57.324502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-edaeb3cb-0bb3-475c-af26-15062507a6d5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:57.324940 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-edaeb3cb-0bb3-475c-af26-15062507a6d5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:57.402293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-edaeb3cb-0bb3-475c-af26-15062507a6d5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lazy-loading 'services' on Instance uuid 41e12ebd-fe44-4aa9-8f5e-572d91370319 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:13:57.472346 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-edaeb3cb-0bb3-475c-af26-15062507a6d5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "DELETE /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments/8c55b207-608a-48b9-ae14-6c3ee3366f44" status: 202 len: 0 microversion: 2.20 time: 0.159437 Oct 27 14:13:57.472932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 581/964] 10.222.0.85 () {60 vars in 1456 bytes} [Wed Oct 27 14:13:57 2021] DELETE /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments/8c55b207-608a-48b9-ae14-6c3ee3366f44 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:13:57.481931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0600677c-86fd-406c-91ef-1be666392adc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:57.483044 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0600677c-86fd-406c-91ef-1be666392adc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:57.489283 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0600677c-86fd-406c-91ef-1be666392adc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:57.489777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0600677c-86fd-406c-91ef-1be666392adc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:57.490661 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0600677c-86fd-406c-91ef-1be666392adc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:57.491238 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0600677c-86fd-406c-91ef-1be666392adc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:57.523097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0600677c-86fd-406c-91ef-1be666392adc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045692 Oct 27 14:13:57.523721 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 582/965] 10.222.0.85 () {60 vars in 1342 bytes} [Wed Oct 27 14:13:57 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:13:58.534886 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dfa05d04-c7a6-4b7f-ada5-0b7080e4de60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:58.535853 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dfa05d04-c7a6-4b7f-ada5-0b7080e4de60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:58.542795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfa05d04-c7a6-4b7f-ada5-0b7080e4de60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:58.543562 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfa05d04-c7a6-4b7f-ada5-0b7080e4de60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:58.544352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfa05d04-c7a6-4b7f-ada5-0b7080e4de60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:58.544785 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dfa05d04-c7a6-4b7f-ada5-0b7080e4de60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:58.576726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dfa05d04-c7a6-4b7f-ada5-0b7080e4de60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045700 Oct 27 14:13:58.577403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 583/966] 10.222.0.85 () {60 vars in 1342 bytes} [Wed Oct 27 14:13:58 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:13:59.589184 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d0ddf714-39c1-4346-930b-929fb9c8bb10 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:59.590377 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d0ddf714-39c1-4346-930b-929fb9c8bb10 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:59.598169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d0ddf714-39c1-4346-930b-929fb9c8bb10 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:59.598943 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d0ddf714-39c1-4346-930b-929fb9c8bb10 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:59.599829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d0ddf714-39c1-4346-930b-929fb9c8bb10 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:59.600272 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d0ddf714-39c1-4346-930b-929fb9c8bb10 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:59.632801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d0ddf714-39c1-4346-930b-929fb9c8bb10 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047591 Oct 27 14:13:59.633382 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 584/967] 10.222.0.85 () {60 vars in 1342 bytes} [Wed Oct 27 14:13:59 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:13:59.691472 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-796e1983-e13b-4e73-88c1-12ba2465d647 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:59.692003 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-796e1983-e13b-4e73-88c1-12ba2465d647 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:59.699451 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-796e1983-e13b-4e73-88c1-12ba2465d647 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:59.699911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-796e1983-e13b-4e73-88c1-12ba2465d647 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:59.701111 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-796e1983-e13b-4e73-88c1-12ba2465d647 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:59.701589 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-796e1983-e13b-4e73-88c1-12ba2465d647 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:59.727620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-796e1983-e13b-4e73-88c1-12ba2465d647 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:13:59.813474 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-796e1983-e13b-4e73-88c1-12ba2465d647 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "DELETE /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 204 len: 0 microversion: 2.20 time: 0.125360 Oct 27 14:13:59.814063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 585/968] 10.222.0.85 () {60 vars in 1279 bytes} [Wed Oct 27 14:13:59 2021] DELETE /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 14:13:59.823666 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-45a02fad-c78d-477a-9883-b9bfa0059163 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:13:59.824375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-45a02fad-c78d-477a-9883-b9bfa0059163 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:13:59.830203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45a02fad-c78d-477a-9883-b9bfa0059163 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:59.830656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45a02fad-c78d-477a-9883-b9bfa0059163 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:59.831449 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45a02fad-c78d-477a-9883-b9bfa0059163 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:13:59.831883 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45a02fad-c78d-477a-9883-b9bfa0059163 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:13:59.957534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-45a02fad-c78d-477a-9883-b9bfa0059163 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:59.966099 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-45a02fad-c78d-477a-9883-b9bfa0059163 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:59.967623 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-45a02fad-c78d-477a-9883-b9bfa0059163 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:13:59.968781 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-45a02fad-c78d-477a-9883-b9bfa0059163 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.149436 Oct 27 14:13:59.969335 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 586/969] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:13:59 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:14:00.989213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-53c096ee-2072-407e-bfc5-3bbdd8e3d8b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:00.989857 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-53c096ee-2072-407e-bfc5-3bbdd8e3d8b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:00.996152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53c096ee-2072-407e-bfc5-3bbdd8e3d8b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:00.996597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53c096ee-2072-407e-bfc5-3bbdd8e3d8b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:00.997363 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53c096ee-2072-407e-bfc5-3bbdd8e3d8b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:00.997794 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53c096ee-2072-407e-bfc5-3bbdd8e3d8b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:01.119684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-53c096ee-2072-407e-bfc5-3bbdd8e3d8b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:01.127982 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-53c096ee-2072-407e-bfc5-3bbdd8e3d8b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:01.129494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-53c096ee-2072-407e-bfc5-3bbdd8e3d8b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:01.130684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-53c096ee-2072-407e-bfc5-3bbdd8e3d8b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.145203 Oct 27 14:14:01.131270 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 587/970] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:00 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:14:02.153549 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-845cb505-3dae-4940-acb8-f7ebfd7ad586 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:02.154330 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-845cb505-3dae-4940-acb8-f7ebfd7ad586 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:02.161646 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-845cb505-3dae-4940-acb8-f7ebfd7ad586 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:02.162009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-845cb505-3dae-4940-acb8-f7ebfd7ad586 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:02.162793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-845cb505-3dae-4940-acb8-f7ebfd7ad586 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:02.163246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-845cb505-3dae-4940-acb8-f7ebfd7ad586 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:02.685284 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-845cb505-3dae-4940-acb8-f7ebfd7ad586 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:02.693510 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-845cb505-3dae-4940-acb8-f7ebfd7ad586 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:02.696526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-845cb505-3dae-4940-acb8-f7ebfd7ad586 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:02.697779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-845cb505-3dae-4940-acb8-f7ebfd7ad586 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1724 microversion: 2.20 time: 0.551522 Oct 27 14:14:02.698368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 588/971] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:02 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1724 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:14:03.717345 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:03.718786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:03.725962 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:03.726766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:03.727717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:03.728507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:03.770888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:03.771799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:03.772711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lazy-loading 'fault' on Instance uuid 41e12ebd-fe44-4aa9-8f5e-572d91370319 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:14:03.825403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:03.836647 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:03.840257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:03.841774 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-71bfe80f-c62d-493f-b31b-2377e3bf51a2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 200 len: 1371 microversion: 2.20 time: 0.129011 Oct 27 14:14:03.854187 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 589/972] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:03 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 1371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:14:04.863178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bd8d9a1c-e8e6-4fb6-a810-ac39a4e3a87e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:04.866661 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-bd8d9a1c-e8e6-4fb6-a810-ac39a4e3a87e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:04.885643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd8d9a1c-e8e6-4fb6-a810-ac39a4e3a87e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:04.886491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd8d9a1c-e8e6-4fb6-a810-ac39a4e3a87e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:04.888044 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd8d9a1c-e8e6-4fb6-a810-ac39a4e3a87e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:04.888418 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd8d9a1c-e8e6-4fb6-a810-ac39a4e3a87e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:04.904691 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-bd8d9a1c-e8e6-4fb6-a810-ac39a4e3a87e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] HTTP exception thrown: Instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 could not be found. Oct 27 14:14:04.905290 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bd8d9a1c-e8e6-4fb6-a810-ac39a4e3a87e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Returning 404 to user: Instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:14:04.906173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bd8d9a1c-e8e6-4fb6-a810-ac39a4e3a87e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 404 len: 111 microversion: 2.20 time: 0.048771 Oct 27 14:14:04.906732 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 590/973] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:04 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 14:14:04.918316 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-99f78675-db74-437f-8b04-01239a80339b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '.version_select at 0x7f4570890940>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:04.940099 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-99f78675-db74-437f-8b04-01239a80339b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-226428762" status: 204 len: 0 microversion: 2.20 time: 0.027310 Oct 27 14:14:04.940911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 591/974] 10.222.0.85 () {60 vars in 1258 bytes} [Wed Oct 27 14:14:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-226428762 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 14:14:05.693335 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-99504a6b-2f19-4247-9864-d2514a3815a5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'create', calling method: .version_select at 0x7f457067c550>, body: {"keypair": {"name": "tempest-keypair-742587953"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:05.716081 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-99504a6b-2f19-4247-9864-d2514a3815a5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for project c84e18e41f634c02ac87674f5f6da28d. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:14:05.720457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-99504a6b-2f19-4247-9864-d2514a3815a5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for user d777531f3785498189495db0e1932c26 and project c84e18e41f634c02ac87674f5f6da28d. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:14:05.917456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-99504a6b-2f19-4247-9864-d2514a3815a5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for project c84e18e41f634c02ac87674f5f6da28d. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:14:05.921048 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-99504a6b-2f19-4247-9864-d2514a3815a5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for user d777531f3785498189495db0e1932c26 and project c84e18e41f634c02ac87674f5f6da28d. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:14:05.933583 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-99504a6b-2f19-4247-9864-d2514a3815a5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.245587 Oct 27 14:14:05.934480 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 592/975] 10.222.0.85 () {62 vars in 1198 bytes} [Wed Oct 27 14:14:05 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 247 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Oct 27 14:14:06.294495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-948e2c8a-f514-4578-9552-b33668833b0c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:06.295454 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-948e2c8a-f514-4578-9552-b33668833b0c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:06.301923 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-948e2c8a-f514-4578-9552-b33668833b0c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:06.302376 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-948e2c8a-f514-4578-9552-b33668833b0c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:06.303169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-948e2c8a-f514-4578-9552-b33668833b0c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:06.303608 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-948e2c8a-f514-4578-9552-b33668833b0c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:06.336840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-948e2c8a-f514-4578-9552-b33668833b0c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046990 Oct 27 14:14:06.337406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 593/976] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:14:06 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:06.393882 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-98e0deef-4e63-4d02-ab7f-f9f862fdce09 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:06.394382 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-98e0deef-4e63-4d02-ab7f-f9f862fdce09 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:06.403050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-98e0deef-4e63-4d02-ab7f-f9f862fdce09 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:06.403601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-98e0deef-4e63-4d02-ab7f-f9f862fdce09 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:06.404381 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-98e0deef-4e63-4d02-ab7f-f9f862fdce09 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:06.404819 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-98e0deef-4e63-4d02-ab7f-f9f862fdce09 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:06.434442 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-98e0deef-4e63-4d02-ab7f-f9f862fdce09 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:14:06.536915 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-98e0deef-4e63-4d02-ab7f-f9f862fdce09 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "DELETE /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 204 len: 0 microversion: 2.1 time: 0.146876 Oct 27 14:14:06.539842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 594/977] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:14:06 2021] DELETE /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:14:06.549216 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-445f7da5-1b24-4dc1-8659-9fd7965738e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:06.549913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-445f7da5-1b24-4dc1-8659-9fd7965738e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:06.556301 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-445f7da5-1b24-4dc1-8659-9fd7965738e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:06.556747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-445f7da5-1b24-4dc1-8659-9fd7965738e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:06.557529 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-445f7da5-1b24-4dc1-8659-9fd7965738e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:06.558024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-445f7da5-1b24-4dc1-8659-9fd7965738e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:06.684774 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-445f7da5-1b24-4dc1-8659-9fd7965738e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:06.692388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-445f7da5-1b24-4dc1-8659-9fd7965738e9 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1673 microversion: 2.1 time: 0.147202 Oct 27 14:14:06.692996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 595/978] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:06 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:07.249391 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-219381837", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11f7b24e-a72d-42e4-91c7-58ce8c0bc8de"}], "security_groups": [{"name": "tempest-securitygroup--112196562"}], "key_name": "tempest-keypair-742587953", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:07.341249 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] validate_networks() for [('11f7b24e-a72d-42e4-91c7-58ce8c0bc8de', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:14:07.848712 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:14:07.849135 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:14:07.849605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:14:07.850014 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:14:07.850423 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:14:07.860024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:07.860644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:07.861537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:07.862052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:07.880009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for project c84e18e41f634c02ac87674f5f6da28d. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:14:07.884135 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Getting quotas for user d777531f3785498189495db0e1932c26 and project c84e18e41f634c02ac87674f5f6da28d. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:14:07.896222 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:14:07.898521 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:14:07.951671 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d2cba65a-124b-4990-a909-80caf1adc319 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.706263 Oct 27 14:14:07.952315 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 596/979] 10.222.0.85 () {62 vars in 1187 bytes} [Wed Oct 27 14:14:07 2021] POST /compute/v2.1/servers => generated 401 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 27 14:14:07.960426 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-01008e3d-1c6c-4734-81d0-e9712e2f8695 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:07.961238 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-01008e3d-1c6c-4734-81d0-e9712e2f8695 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:07.968907 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-01008e3d-1c6c-4734-81d0-e9712e2f8695 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:07.969412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-01008e3d-1c6c-4734-81d0-e9712e2f8695 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:07.970412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-01008e3d-1c6c-4734-81d0-e9712e2f8695 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:07.970852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-01008e3d-1c6c-4734-81d0-e9712e2f8695 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:08.221059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-01008e3d-1c6c-4734-81d0-e9712e2f8695 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:08.230236 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-01008e3d-1c6c-4734-81d0-e9712e2f8695 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1673 microversion: 2.1 time: 0.273251 Oct 27 14:14:08.231427 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 597/980] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:07 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1673 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:08.235581 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-176031ff-47f4-45f0-a86c-e0d3394f8329 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:08.236378 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-176031ff-47f4-45f0-a86c-e0d3394f8329 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:08.324615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-176031ff-47f4-45f0-a86c-e0d3394f8329 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:08.332213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-176031ff-47f4-45f0-a86c-e0d3394f8329 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:08.334395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-176031ff-47f4-45f0-a86c-e0d3394f8329 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:08.336628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-176031ff-47f4-45f0-a86c-e0d3394f8329 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1280 microversion: 2.20 time: 0.103748 Oct 27 14:14:08.337262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 598/981] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:08 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:14:09.248443 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:09.249483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:09.255643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:09.256089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:09.256875 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:09.257330 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:09.290646 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:09.291094 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:09.291576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lazy-loading 'fault' on Instance uuid 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:14:09.346382 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:09.357830 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1d44f8b7-3df4-447a-8b65-7580c1f6c58e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 200 len: 1328 microversion: 2.1 time: 0.113706 Oct 27 14:14:09.358717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 599/982] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:09 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 1328 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:09.363627 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1109a382-0c30-46b7-8589-11fd66e618ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:09.364443 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1109a382-0c30-46b7-8589-11fd66e618ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:09.371444 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1109a382-0c30-46b7-8589-11fd66e618ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:09.372104 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1109a382-0c30-46b7-8589-11fd66e618ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:09.373115 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1109a382-0c30-46b7-8589-11fd66e618ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:09.374065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1109a382-0c30-46b7-8589-11fd66e618ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:09.481373 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1109a382-0c30-46b7-8589-11fd66e618ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:09.496214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1109a382-0c30-46b7-8589-11fd66e618ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:09.501172 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1109a382-0c30-46b7-8589-11fd66e618ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:09.502278 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1109a382-0c30-46b7-8589-11fd66e618ca tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1338 microversion: 2.20 time: 0.142381 Oct 27 14:14:09.503110 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 600/983] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:09 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1338 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:14:10.377325 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8184c303-0756-4d49-aa70-afa048dfd430 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:10.377325 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8184c303-0756-4d49-aa70-afa048dfd430 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:10.389299 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8184c303-0756-4d49-aa70-afa048dfd430 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:10.390746 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8184c303-0756-4d49-aa70-afa048dfd430 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:10.392377 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8184c303-0756-4d49-aa70-afa048dfd430 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:10.393142 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8184c303-0756-4d49-aa70-afa048dfd430 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:10.413370 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-8184c303-0756-4d49-aa70-afa048dfd430 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] HTTP exception thrown: Instance 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 could not be found. Oct 27 14:14:10.414071 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8184c303-0756-4d49-aa70-afa048dfd430 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Returning 404 to user: Instance 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:14:10.414930 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8184c303-0756-4d49-aa70-afa048dfd430 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 404 len: 111 microversion: 2.1 time: 0.042982 Oct 27 14:14:10.415890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 601/984] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:10 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:14:10.425605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e6101080-13f5-40b0-98a8-03f453fdc09b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '.version_select at 0x7f45707b89d0>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:10.446097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e6101080-13f5-40b0-98a8-03f453fdc09b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890036324" status: 202 len: 0 microversion: 2.1 time: 0.024801 Oct 27 14:14:10.450377 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 602/985] 10.222.0.85 () {58 vars in 1220 bytes} [Wed Oct 27 14:14:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890036324 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:10.521418 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0d1660fe-68dd-4211-9a3e-dce0a82473ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:10.522317 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0d1660fe-68dd-4211-9a3e-dce0a82473ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:10.529945 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d1660fe-68dd-4211-9a3e-dce0a82473ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:10.530399 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d1660fe-68dd-4211-9a3e-dce0a82473ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:10.531449 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d1660fe-68dd-4211-9a3e-dce0a82473ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:10.532245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d1660fe-68dd-4211-9a3e-dce0a82473ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:10.765131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0d1660fe-68dd-4211-9a3e-dce0a82473ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:10.774159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0d1660fe-68dd-4211-9a3e-dce0a82473ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:10.775694 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0d1660fe-68dd-4211-9a3e-dce0a82473ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:10.777051 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0d1660fe-68dd-4211-9a3e-dce0a82473ab tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1405 microversion: 2.20 time: 0.259188 Oct 27 14:14:10.777680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 603/986] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:10 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:14:11.258783 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8b0054d9-c54a-47cf-8e7d-c8f282a85548 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'create', calling method: .version_select at 0x7f4570852820>, body: {"keypair": {"name": "tempest-keypair-1159898855"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:11.276519 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-8b0054d9-c54a-47cf-8e7d-c8f282a85548 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:14:11.281264 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-8b0054d9-c54a-47cf-8e7d-c8f282a85548 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for user ff5c722cc57744d886ba552ce2571745 and project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:14:11.362135 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-8b0054d9-c54a-47cf-8e7d-c8f282a85548 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:14:11.365888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-8b0054d9-c54a-47cf-8e7d-c8f282a85548 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for user ff5c722cc57744d886ba552ce2571745 and project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'key_pairs'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:14:11.379268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8b0054d9-c54a-47cf-8e7d-c8f282a85548 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.124184 Oct 27 14:14:11.380579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 604/987] 10.222.0.85 () {60 vars in 1157 bytes} [Wed Oct 27 14:14:11 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:11.796295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-85eb11a6-76aa-419d-9f60-acd06901aada tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:11.796916 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-85eb11a6-76aa-419d-9f60-acd06901aada tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:11.802842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85eb11a6-76aa-419d-9f60-acd06901aada tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:11.803329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85eb11a6-76aa-419d-9f60-acd06901aada tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:11.804126 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85eb11a6-76aa-419d-9f60-acd06901aada tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:11.804715 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85eb11a6-76aa-419d-9f60-acd06901aada tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:11.929940 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-85eb11a6-76aa-419d-9f60-acd06901aada tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:11.938590 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-85eb11a6-76aa-419d-9f60-acd06901aada tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:11.940067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-85eb11a6-76aa-419d-9f60-acd06901aada tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:11.941173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-85eb11a6-76aa-419d-9f60-acd06901aada tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1405 microversion: 2.20 time: 0.150006 Oct 27 14:14:11.941976 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 605/988] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:11 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:14:12.781027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-51957460", "imageRef": "9a845c05-6eba-45dc-bc0c-8a554d4fe190", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57ab640a-d6ea-4ec6-b7cb-d71aba31dbee"}], "security_groups": [{"name": "tempest-securitygroup--771580204"}], "key_name": "tempest-keypair-1159898855", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:12.868203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] validate_networks() for [('57ab640a-d6ea-4ec6-b7cb-d71aba31dbee', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:14:13.238155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:14:13.238598 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:14:13.239067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:14:13.239498 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:14:13.239907 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:14:13.248843 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:13.249297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:13.250089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:13.250520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:13.267972 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:14:13.271680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Getting quotas for user ff5c722cc57744d886ba552ce2571745 and project 81aae1f72a0c4ea9918b36e3c7aef02b. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:14:13.283595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:14:13.285793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a845c05-6eba-45dc-bc0c-8a554d4fe190',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:14:13.332956 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-11d1272d-d019-45bc-a5fb-c0fa3cc6c6a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.556481 Oct 27 14:14:13.333600 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 606/989] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:14:12 2021] POST /compute/v2.1/servers => generated 401 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 14:14:13.337964 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-544a06b6-f32b-4d0b-a9d3-ee7a17bbf404 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:13.338611 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-544a06b6-f32b-4d0b-a9d3-ee7a17bbf404 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:13.345178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-544a06b6-f32b-4d0b-a9d3-ee7a17bbf404 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:13.345628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-544a06b6-f32b-4d0b-a9d3-ee7a17bbf404 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:13.346392 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-544a06b6-f32b-4d0b-a9d3-ee7a17bbf404 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:13.346822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-544a06b6-f32b-4d0b-a9d3-ee7a17bbf404 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:13.472447 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-544a06b6-f32b-4d0b-a9d3-ee7a17bbf404 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:13.482587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-544a06b6-f32b-4d0b-a9d3-ee7a17bbf404 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:13.484108 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-544a06b6-f32b-4d0b-a9d3-ee7a17bbf404 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:13.485210 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-544a06b6-f32b-4d0b-a9d3-ee7a17bbf404 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1405 microversion: 2.20 time: 0.150705 Oct 27 14:14:13.485989 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 607/990] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:13 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:14:13.490219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-468fd014-2f5f-4102-b9a9-01865ddae588 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:13.490815 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-468fd014-2f5f-4102-b9a9-01865ddae588 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:13.551919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-468fd014-2f5f-4102-b9a9-01865ddae588 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:13.559436 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-468fd014-2f5f-4102-b9a9-01865ddae588 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1236 microversion: 2.1 time: 0.072305 Oct 27 14:14:13.560077 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 608/991] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:13 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:13.564969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e0c3061e-c2fe-4b5a-ac43-6fc82bea6efd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:13.565473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e0c3061e-c2fe-4b5a-ac43-6fc82bea6efd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:13.571679 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0c3061e-c2fe-4b5a-ac43-6fc82bea6efd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:13.572163 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0c3061e-c2fe-4b5a-ac43-6fc82bea6efd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:13.572940 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0c3061e-c2fe-4b5a-ac43-6fc82bea6efd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:13.573374 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0c3061e-c2fe-4b5a-ac43-6fc82bea6efd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:13.600187 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e0c3061e-c2fe-4b5a-ac43-6fc82bea6efd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:14:13.679351 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e0c3061e-c2fe-4b5a-ac43-6fc82bea6efd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "DELETE /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 204 len: 0 microversion: 2.1 time: 0.117940 Oct 27 14:14:13.680150 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 609/992] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:14:13 2021] DELETE /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 14:14:13.689246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0672e00c-c73f-4515-975d-e0c188348da0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:13.689953 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0672e00c-c73f-4515-975d-e0c188348da0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:13.695983 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0672e00c-c73f-4515-975d-e0c188348da0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:13.696437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0672e00c-c73f-4515-975d-e0c188348da0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:13.697210 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0672e00c-c73f-4515-975d-e0c188348da0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:13.697641 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0672e00c-c73f-4515-975d-e0c188348da0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:13.826968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0672e00c-c73f-4515-975d-e0c188348da0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:13.835269 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0672e00c-c73f-4515-975d-e0c188348da0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1575 microversion: 2.1 time: 0.149868 Oct 27 14:14:13.835844 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 610/993] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:13 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:14.502939 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e0a4a51d-dd4b-4baa-8ac7-1009cb3a91a3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:14.504090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e0a4a51d-dd4b-4baa-8ac7-1009cb3a91a3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:14.510851 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0a4a51d-dd4b-4baa-8ac7-1009cb3a91a3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:14.512092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0a4a51d-dd4b-4baa-8ac7-1009cb3a91a3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:14.512991 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0a4a51d-dd4b-4baa-8ac7-1009cb3a91a3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:14.513429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e0a4a51d-dd4b-4baa-8ac7-1009cb3a91a3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:14.724084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e0a4a51d-dd4b-4baa-8ac7-1009cb3a91a3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:14.736301 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e0a4a51d-dd4b-4baa-8ac7-1009cb3a91a3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:14.737803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e0a4a51d-dd4b-4baa-8ac7-1009cb3a91a3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:14.739169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e0a4a51d-dd4b-4baa-8ac7-1009cb3a91a3 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1405 microversion: 2.20 time: 0.240050 Oct 27 14:14:14.740145 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 611/994] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:14 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1405 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:14:14.746765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-de9954e1-f2a9-4260-843b-c5481340ef24 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:14.747481 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-de9954e1-f2a9-4260-843b-c5481340ef24 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:14.754464 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-de9954e1-f2a9-4260-843b-c5481340ef24 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:14.754918 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-de9954e1-f2a9-4260-843b-c5481340ef24 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:14.756270 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-de9954e1-f2a9-4260-843b-c5481340ef24 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:14.757061 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-de9954e1-f2a9-4260-843b-c5481340ef24 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:14.831515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-de9954e1-f2a9-4260-843b-c5481340ef24 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:14.838783 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-de9954e1-f2a9-4260-843b-c5481340ef24 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1294 microversion: 2.1 time: 0.097163 Oct 27 14:14:14.839690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 612/995] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:14 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:14.853638 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-647e730b-9e30-4676-9b3e-849fda92ccb7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:14.854246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-647e730b-9e30-4676-9b3e-849fda92ccb7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:14.861070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-647e730b-9e30-4676-9b3e-849fda92ccb7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:14.861508 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-647e730b-9e30-4676-9b3e-849fda92ccb7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:14.862275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-647e730b-9e30-4676-9b3e-849fda92ccb7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:14.862727 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-647e730b-9e30-4676-9b3e-849fda92ccb7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:15.073226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-647e730b-9e30-4676-9b3e-849fda92ccb7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:15.082643 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-647e730b-9e30-4676-9b3e-849fda92ccb7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1575 microversion: 2.1 time: 0.232596 Oct 27 14:14:15.083370 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 613/996] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:14 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:15.758615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c13744d1-1be3-4f2d-999c-72c859f8da3b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:15.759257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c13744d1-1be3-4f2d-999c-72c859f8da3b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:15.767149 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c13744d1-1be3-4f2d-999c-72c859f8da3b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:15.767862 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c13744d1-1be3-4f2d-999c-72c859f8da3b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:15.768920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c13744d1-1be3-4f2d-999c-72c859f8da3b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:15.769519 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c13744d1-1be3-4f2d-999c-72c859f8da3b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:16.068300 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c13744d1-1be3-4f2d-999c-72c859f8da3b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:16.076819 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c13744d1-1be3-4f2d-999c-72c859f8da3b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:16.078336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c13744d1-1be3-4f2d-999c-72c859f8da3b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:16.079484 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c13744d1-1be3-4f2d-999c-72c859f8da3b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1405 microversion: 2.20 time: 0.325541 Oct 27 14:14:16.080046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 614/997] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:15 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1405 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:14:16.084451 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7fce2171-61b3-4e3f-b84e-852102a2ccd5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:16.084933 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7fce2171-61b3-4e3f-b84e-852102a2ccd5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:16.090939 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fce2171-61b3-4e3f-b84e-852102a2ccd5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:16.091424 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fce2171-61b3-4e3f-b84e-852102a2ccd5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:16.092205 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fce2171-61b3-4e3f-b84e-852102a2ccd5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:16.092642 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fce2171-61b3-4e3f-b84e-852102a2ccd5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:16.475165 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7fce2171-61b3-4e3f-b84e-852102a2ccd5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:16.483030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7fce2171-61b3-4e3f-b84e-852102a2ccd5 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1361 microversion: 2.1 time: 0.401977 Oct 27 14:14:16.483642 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 615/998] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:16 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:16.487916 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c8cb405a-ba43-42af-a8d5-4935f42c0dbc tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:16.488737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c8cb405a-ba43-42af-a8d5-4935f42c0dbc tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:16.494831 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c8cb405a-ba43-42af-a8d5-4935f42c0dbc tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:16.495488 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c8cb405a-ba43-42af-a8d5-4935f42c0dbc tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:16.496901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c8cb405a-ba43-42af-a8d5-4935f42c0dbc tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:16.497336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c8cb405a-ba43-42af-a8d5-4935f42c0dbc tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:16.795023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c8cb405a-ba43-42af-a8d5-4935f42c0dbc tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:16.802840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c8cb405a-ba43-42af-a8d5-4935f42c0dbc tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1575 microversion: 2.1 time: 0.318183 Oct 27 14:14:16.803459 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 616/999] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:16 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1575 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:17.097925 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-eca5c4b8-b77d-47a5-943b-901f94c89ec1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:17.098657 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-eca5c4b8-b77d-47a5-943b-901f94c89ec1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:17.105617 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eca5c4b8-b77d-47a5-943b-901f94c89ec1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:17.106218 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eca5c4b8-b77d-47a5-943b-901f94c89ec1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:17.107032 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eca5c4b8-b77d-47a5-943b-901f94c89ec1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:17.107530 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eca5c4b8-b77d-47a5-943b-901f94c89ec1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:17.458067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-eca5c4b8-b77d-47a5-943b-901f94c89ec1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:17.467565 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-eca5c4b8-b77d-47a5-943b-901f94c89ec1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:17.469457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-eca5c4b8-b77d-47a5-943b-901f94c89ec1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:17.471294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-eca5c4b8-b77d-47a5-943b-901f94c89ec1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1405 microversion: 2.20 time: 0.377225 Oct 27 14:14:17.471938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 617/1000] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:17 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1405 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:14:17.599251 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-ebd9675c-97b8-40a2-aaef-ae5ac76a46e4 req-0d3835e4-1b7e-46b9-80c6-d401934718f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e905cb-2edf-4221-933f-a7c59abcd554", "name": "network-vif-plugged", "status": "completed", "tag": "7cb0b496-4ac4-4e36-a183-d35a08ddccae"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:17.600941 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:14:17.600941 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:14:17.608236 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-ebd9675c-97b8-40a2-aaef-ae5ac76a46e4 req-0d3835e4-1b7e-46b9-80c6-d401934718f0 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:17.608684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-ebd9675c-97b8-40a2-aaef-ae5ac76a46e4 req-0d3835e4-1b7e-46b9-80c6-d401934718f0 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:17.621417 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-ebd9675c-97b8-40a2-aaef-ae5ac76a46e4 req-0d3835e4-1b7e-46b9-80c6-d401934718f0 service nova] Creating event network-vif-plugged:7cb0b496-4ac4-4e36-a183-d35a08ddccae for instance e2e905cb-2edf-4221-933f-a7c59abcd554 on hv-cinder-81566 Oct 27 14:14:17.631425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-ebd9675c-97b8-40a2-aaef-ae5ac76a46e4 req-0d3835e4-1b7e-46b9-80c6-d401934718f0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153246 Oct 27 14:14:17.632420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 618/1001] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:14:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:14:17.639201 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-650d818c-c764-4b70-abda-e1fae53cb1b1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:17.641539 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-650d818c-c764-4b70-abda-e1fae53cb1b1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:17.652950 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-650d818c-c764-4b70-abda-e1fae53cb1b1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:17.653399 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-650d818c-c764-4b70-abda-e1fae53cb1b1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:17.654200 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-650d818c-c764-4b70-abda-e1fae53cb1b1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:17.654631 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-650d818c-c764-4b70-abda-e1fae53cb1b1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:17.838735 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-650d818c-c764-4b70-abda-e1fae53cb1b1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:17.849035 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-650d818c-c764-4b70-abda-e1fae53cb1b1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1361 microversion: 2.1 time: 0.215091 Oct 27 14:14:17.850358 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 619/1002] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:17 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:17.862639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8c3a30bf-368d-4c32-9e89-c9e1797ba43d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:17.863300 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8c3a30bf-368d-4c32-9e89-c9e1797ba43d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:17.869255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c3a30bf-368d-4c32-9e89-c9e1797ba43d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:17.869842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c3a30bf-368d-4c32-9e89-c9e1797ba43d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:17.870904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c3a30bf-368d-4c32-9e89-c9e1797ba43d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:17.871363 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c3a30bf-368d-4c32-9e89-c9e1797ba43d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:17.939379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8c3a30bf-368d-4c32-9e89-c9e1797ba43d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:17.951211 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8c3a30bf-368d-4c32-9e89-c9e1797ba43d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 200 len: 1225 microversion: 2.1 time: 0.099177 Oct 27 14:14:17.951802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 620/1003] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:17 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:18.490636 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b145a0b1-7f6e-4019-8d29-62e6e28902f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:18.490636 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b145a0b1-7f6e-4019-8d29-62e6e28902f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:18.498058 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b145a0b1-7f6e-4019-8d29-62e6e28902f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:18.498611 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b145a0b1-7f6e-4019-8d29-62e6e28902f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:18.499421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b145a0b1-7f6e-4019-8d29-62e6e28902f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:18.499851 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b145a0b1-7f6e-4019-8d29-62e6e28902f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:18.644195 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b145a0b1-7f6e-4019-8d29-62e6e28902f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:18.652739 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b145a0b1-7f6e-4019-8d29-62e6e28902f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:18.655215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b145a0b1-7f6e-4019-8d29-62e6e28902f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:18.656600 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b145a0b1-7f6e-4019-8d29-62e6e28902f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1405 microversion: 2.20 time: 0.170775 Oct 27 14:14:18.657164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 621/1004] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:18 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:14:18.865784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9177c850-d0f0-405e-be61-dcfd627e34de tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:18.866455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9177c850-d0f0-405e-be61-dcfd627e34de tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:18.873051 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9177c850-d0f0-405e-be61-dcfd627e34de tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:18.873535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9177c850-d0f0-405e-be61-dcfd627e34de tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:18.874263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9177c850-d0f0-405e-be61-dcfd627e34de tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:18.874683 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9177c850-d0f0-405e-be61-dcfd627e34de tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:18.996843 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9177c850-d0f0-405e-be61-dcfd627e34de tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:19.004176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9177c850-d0f0-405e-be61-dcfd627e34de tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1361 microversion: 2.1 time: 0.142210 Oct 27 14:14:19.005070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 622/1005] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:18 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1361 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:19.009439 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-13d077ec-bfce-4cac-a7bb-49446843918e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:19.010160 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-13d077ec-bfce-4cac-a7bb-49446843918e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:19.016589 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-13d077ec-bfce-4cac-a7bb-49446843918e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:19.017313 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-13d077ec-bfce-4cac-a7bb-49446843918e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:19.018088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-13d077ec-bfce-4cac-a7bb-49446843918e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:19.018525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-13d077ec-bfce-4cac-a7bb-49446843918e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:19.032416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-13d077ec-bfce-4cac-a7bb-49446843918e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] HTTP exception thrown: Instance 75d89b0d-7f54-43fe-ac03-194305453349 could not be found. Oct 27 14:14:19.033063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-13d077ec-bfce-4cac-a7bb-49446843918e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Returning 404 to user: Instance 75d89b0d-7f54-43fe-ac03-194305453349 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:14:19.033896 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-13d077ec-bfce-4cac-a7bb-49446843918e tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 404 len: 111 microversion: 2.1 time: 0.027901 Oct 27 14:14:19.034445 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 623/1006] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:19 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:14:19.131819 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-915814741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1521029144", "security_groups": [{"name": "tempest-secgroup-smoke-867368291"}], "block_device_mapping_v2": [{"uuid": "fc9dc3e2-8779-469d-ba48-1fd058d07239", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9af09723-d748-420c-9b75-4c97db8a5445"}]}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:19.237786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] validate_networks() for [('9af09723-d748-420c-9b75-4c97db8a5445', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:14:19.609880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:14:19.610440 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:14:19.610756 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:14:19.611189 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:14:19.611599 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:14:19.621089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:19.621759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:19.622571 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:19.622999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:19.639331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Getting quotas for project 925d32172c5f44168c2eddeffc0a7da1. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:14:19.643473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Getting quotas for user aa9c479260384120a439e7f8c2dd122f and project 925d32172c5f44168c2eddeffc0a7da1. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:14:19.699177 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:14:19.701297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc9dc3e2-8779-469d-ba48-1fd058d07239',volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:14:19.822232 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4c98f271-7926-47b9-a880-099fdb988cba tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.694460 Oct 27 14:14:19.822873 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 624/1007] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:14:19 2021] POST /compute/v2.1/servers => generated 405 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 14:14:19.828343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d4665870-ba6d-4adf-aedd-8b61d5e9eb60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:19.829146 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d4665870-ba6d-4adf-aedd-8b61d5e9eb60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:19.835810 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d4665870-ba6d-4adf-aedd-8b61d5e9eb60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:19.836256 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d4665870-ba6d-4adf-aedd-8b61d5e9eb60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:19.837013 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d4665870-ba6d-4adf-aedd-8b61d5e9eb60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:19.837438 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d4665870-ba6d-4adf-aedd-8b61d5e9eb60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:19.965129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d4665870-ba6d-4adf-aedd-8b61d5e9eb60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:19.973218 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d4665870-ba6d-4adf-aedd-8b61d5e9eb60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:19.974718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d4665870-ba6d-4adf-aedd-8b61d5e9eb60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:19.975911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d4665870-ba6d-4adf-aedd-8b61d5e9eb60 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1598 microversion: 2.20 time: 0.152082 Oct 27 14:14:19.976541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 625/1008] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:14:19 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:14:19.981474 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9c12c1a5-6a81-45e8-961a-6f1b74ff9116 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:19.982072 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9c12c1a5-6a81-45e8-961a-6f1b74ff9116 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:20.040570 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9c12c1a5-6a81-45e8-961a-6f1b74ff9116 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:20.047780 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9c12c1a5-6a81-45e8-961a-6f1b74ff9116 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1094 microversion: 2.1 time: 0.070157 Oct 27 14:14:20.048275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 626/1009] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:19 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:20.052654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0d93aed3-c63d-4782-a775-9db74ab6f643 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:20.053138 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0d93aed3-c63d-4782-a775-9db74ab6f643 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:20.059639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d93aed3-c63d-4782-a775-9db74ab6f643 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:20.060147 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d93aed3-c63d-4782-a775-9db74ab6f643 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:20.060990 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d93aed3-c63d-4782-a775-9db74ab6f643 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:20.061494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0d93aed3-c63d-4782-a775-9db74ab6f643 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:20.142869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0d93aed3-c63d-4782-a775-9db74ab6f643 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093512 Oct 27 14:14:20.143532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 627/1010] 10.222.0.85 () {60 vars in 1315 bytes} [Wed Oct 27 14:14:20 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:14:20.150353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b5340f54-390a-4d42-8b0d-6df441613768 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:20.150353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b5340f54-390a-4d42-8b0d-6df441613768 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:20.154973 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b5340f54-390a-4d42-8b0d-6df441613768 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:20.155561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b5340f54-390a-4d42-8b0d-6df441613768 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:20.156431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b5340f54-390a-4d42-8b0d-6df441613768 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:20.156970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b5340f54-390a-4d42-8b0d-6df441613768 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:20.296789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b5340f54-390a-4d42-8b0d-6df441613768 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:20.304893 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b5340f54-390a-4d42-8b0d-6df441613768 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1361 microversion: 2.1 time: 0.160349 Oct 27 14:14:20.306063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 628/1011] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:20 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:21.066452 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d4162790-5e7c-4d5b-9f8b-e6dfb1d33798 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:21.067923 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d4162790-5e7c-4d5b-9f8b-e6dfb1d33798 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:21.076663 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d4162790-5e7c-4d5b-9f8b-e6dfb1d33798 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:21.077526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d4162790-5e7c-4d5b-9f8b-e6dfb1d33798 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:21.079213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d4162790-5e7c-4d5b-9f8b-e6dfb1d33798 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:21.079820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d4162790-5e7c-4d5b-9f8b-e6dfb1d33798 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:21.183723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d4162790-5e7c-4d5b-9f8b-e6dfb1d33798 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:21.191080 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d4162790-5e7c-4d5b-9f8b-e6dfb1d33798 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1210 microversion: 2.1 time: 0.129861 Oct 27 14:14:21.192057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 629/1012] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:21 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1210 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:21.205778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3cf4111d-40b6-4b6a-88cf-3d8e9905037e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:21.208789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3cf4111d-40b6-4b6a-88cf-3d8e9905037e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:21.216036 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3cf4111d-40b6-4b6a-88cf-3d8e9905037e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:21.216931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3cf4111d-40b6-4b6a-88cf-3d8e9905037e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:21.220221 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3cf4111d-40b6-4b6a-88cf-3d8e9905037e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:21.220894 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3cf4111d-40b6-4b6a-88cf-3d8e9905037e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:21.296979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3cf4111d-40b6-4b6a-88cf-3d8e9905037e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 14 microversion: 2.20 time: 0.094327 Oct 27 14:14:21.297881 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 630/1013] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:21 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:21.411968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-8630b599-1e98-45ba-8451-9698760eddb3 req-0385969d-2248-40d2-ab51-6f6077acfd8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e905cb-2edf-4221-933f-a7c59abcd554", "tag": "7cb0b496-4ac4-4e36-a183-d35a08ddccae"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:21.413979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:14:21.413979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:14:21.425359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-8630b599-1e98-45ba-8451-9698760eddb3 req-0385969d-2248-40d2-ab51-6f6077acfd8d service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:21.426608 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-8630b599-1e98-45ba-8451-9698760eddb3 req-0385969d-2248-40d2-ab51-6f6077acfd8d service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:21.441283 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-8630b599-1e98-45ba-8451-9698760eddb3 req-0385969d-2248-40d2-ab51-6f6077acfd8d service nova] Creating event network-changed:7cb0b496-4ac4-4e36-a183-d35a08ddccae for instance e2e905cb-2edf-4221-933f-a7c59abcd554 on hv-cinder-81566 Oct 27 14:14:21.466588 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-8630b599-1e98-45ba-8451-9698760eddb3 req-0385969d-2248-40d2-ab51-6f6077acfd8d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164644 Oct 27 14:14:21.471042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 631/1014] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:14:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:14:21.477969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fa4d466f-aa8d-4ad8-a940-047e8661e328 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:21.478659 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fa4d466f-aa8d-4ad8-a940-047e8661e328 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:21.499163 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa4d466f-aa8d-4ad8-a940-047e8661e328 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:21.499617 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa4d466f-aa8d-4ad8-a940-047e8661e328 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:21.500434 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa4d466f-aa8d-4ad8-a940-047e8661e328 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:21.500870 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa4d466f-aa8d-4ad8-a940-047e8661e328 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:21.918788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fa4d466f-aa8d-4ad8-a940-047e8661e328 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:21.927521 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fa4d466f-aa8d-4ad8-a940-047e8661e328 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1361 microversion: 2.1 time: 0.455168 Oct 27 14:14:21.935614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 632/1015] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:21 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1361 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:22.210212 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3c5e4d98-1c06-4d9e-9504-56714eff0ce1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:22.210893 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3c5e4d98-1c06-4d9e-9504-56714eff0ce1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:22.218381 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3c5e4d98-1c06-4d9e-9504-56714eff0ce1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:22.218944 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3c5e4d98-1c06-4d9e-9504-56714eff0ce1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:22.220125 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3c5e4d98-1c06-4d9e-9504-56714eff0ce1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:22.220623 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3c5e4d98-1c06-4d9e-9504-56714eff0ce1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:22.827588 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3c5e4d98-1c06-4d9e-9504-56714eff0ce1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:22.835046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3c5e4d98-1c06-4d9e-9504-56714eff0ce1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.629865 Oct 27 14:14:22.844736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 633/1016] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:22 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:22.844736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7588a9e6-cd6b-416d-9df2-4fb8b8218123 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:22.844736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7588a9e6-cd6b-416d-9df2-4fb8b8218123 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:22.847879 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7588a9e6-cd6b-416d-9df2-4fb8b8218123 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:22.848321 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7588a9e6-cd6b-416d-9df2-4fb8b8218123 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:22.849102 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7588a9e6-cd6b-416d-9df2-4fb8b8218123 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:22.849532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7588a9e6-cd6b-416d-9df2-4fb8b8218123 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:22.917564 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7588a9e6-cd6b-416d-9df2-4fb8b8218123 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 14 microversion: 2.20 time: 0.080451 Oct 27 14:14:22.919226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 634/1017] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:22 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:22.945183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0e6f9842-74b4-4abc-bb06-d545777661dc tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:22.945878 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0e6f9842-74b4-4abc-bb06-d545777661dc tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:22.953104 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e6f9842-74b4-4abc-bb06-d545777661dc tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:22.953550 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e6f9842-74b4-4abc-bb06-d545777661dc tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:22.954324 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e6f9842-74b4-4abc-bb06-d545777661dc tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:22.954755 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0e6f9842-74b4-4abc-bb06-d545777661dc tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:23.230900 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0e6f9842-74b4-4abc-bb06-d545777661dc tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:23.240246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0e6f9842-74b4-4abc-bb06-d545777661dc tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1361 microversion: 2.1 time: 0.298974 Oct 27 14:14:23.240845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 635/1018] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:22 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:23.254723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-e8b6b59f-a40f-49a8-b312-ed688ca4ba77 req-b09b127f-36e9-4f9d-b767-22fd05aed526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2", "name": "network-vif-plugged", "status": "completed", "tag": "dfabc39d-4ff3-4bef-a411-759d83df1689"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:23.256588 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:14:23.256588 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:14:23.264756 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-e8b6b59f-a40f-49a8-b312-ed688ca4ba77 req-b09b127f-36e9-4f9d-b767-22fd05aed526 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:23.264756 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-e8b6b59f-a40f-49a8-b312-ed688ca4ba77 req-b09b127f-36e9-4f9d-b767-22fd05aed526 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:23.278541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-e8b6b59f-a40f-49a8-b312-ed688ca4ba77 req-b09b127f-36e9-4f9d-b767-22fd05aed526 service nova] Creating event network-vif-plugged:dfabc39d-4ff3-4bef-a411-759d83df1689 for instance 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 on hv-cinder-81566 Oct 27 14:14:23.283644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-e8b6b59f-a40f-49a8-b312-ed688ca4ba77 req-b09b127f-36e9-4f9d-b767-22fd05aed526 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032481 Oct 27 14:14:23.284289 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 636/1019] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:14:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:14:23.853131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-026f3089-ba17-47dd-a7da-993b891294ad tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:23.853938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-026f3089-ba17-47dd-a7da-993b891294ad tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:23.860505 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-026f3089-ba17-47dd-a7da-993b891294ad tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:23.861033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-026f3089-ba17-47dd-a7da-993b891294ad tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:23.862224 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-026f3089-ba17-47dd-a7da-993b891294ad tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:23.862366 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-026f3089-ba17-47dd-a7da-993b891294ad tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:24.060559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-026f3089-ba17-47dd-a7da-993b891294ad tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:24.068030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-026f3089-ba17-47dd-a7da-993b891294ad tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.219383 Oct 27 14:14:24.068589 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 637/1020] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:23 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:24.073113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cab3b20a-0fc0-4fa7-a3a2-2b0673ab750d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:24.074728 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cab3b20a-0fc0-4fa7-a3a2-2b0673ab750d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:24.081090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cab3b20a-0fc0-4fa7-a3a2-2b0673ab750d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:24.081551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cab3b20a-0fc0-4fa7-a3a2-2b0673ab750d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:24.082338 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cab3b20a-0fc0-4fa7-a3a2-2b0673ab750d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:24.082774 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cab3b20a-0fc0-4fa7-a3a2-2b0673ab750d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:24.150905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cab3b20a-0fc0-4fa7-a3a2-2b0673ab750d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 14 microversion: 2.20 time: 0.081053 Oct 27 14:14:24.151774 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 638/1021] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:24 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:24.258492 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fafbcb25-2a50-4dbb-8683-2b5905b2b6f3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:24.259207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fafbcb25-2a50-4dbb-8683-2b5905b2b6f3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:24.266443 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fafbcb25-2a50-4dbb-8683-2b5905b2b6f3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:24.266888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fafbcb25-2a50-4dbb-8683-2b5905b2b6f3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:24.268002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fafbcb25-2a50-4dbb-8683-2b5905b2b6f3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:24.268443 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fafbcb25-2a50-4dbb-8683-2b5905b2b6f3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:24.408861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fafbcb25-2a50-4dbb-8683-2b5905b2b6f3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:24.416293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fafbcb25-2a50-4dbb-8683-2b5905b2b6f3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1361 microversion: 2.1 time: 0.161840 Oct 27 14:14:24.416888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 639/1022] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:24 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:25.085619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-29b0fd56-b798-4f3d-8bc5-22d8766a91e0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:25.086145 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-29b0fd56-b798-4f3d-8bc5-22d8766a91e0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:25.092567 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29b0fd56-b798-4f3d-8bc5-22d8766a91e0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:25.093018 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29b0fd56-b798-4f3d-8bc5-22d8766a91e0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:25.093789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29b0fd56-b798-4f3d-8bc5-22d8766a91e0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:25.094227 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29b0fd56-b798-4f3d-8bc5-22d8766a91e0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:25.214204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-29b0fd56-b798-4f3d-8bc5-22d8766a91e0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:25.221633 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-29b0fd56-b798-4f3d-8bc5-22d8766a91e0 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.139775 Oct 27 14:14:25.222202 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 640/1023] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:25 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:25.226553 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-70cc7be2-d5aa-4920-93f3-16d7b9cee86b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:25.227493 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-70cc7be2-d5aa-4920-93f3-16d7b9cee86b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:25.234302 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-70cc7be2-d5aa-4920-93f3-16d7b9cee86b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:25.234756 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-70cc7be2-d5aa-4920-93f3-16d7b9cee86b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:25.235578 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-70cc7be2-d5aa-4920-93f3-16d7b9cee86b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:25.236016 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-70cc7be2-d5aa-4920-93f3-16d7b9cee86b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:25.308556 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-70cc7be2-d5aa-4920-93f3-16d7b9cee86b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 14 microversion: 2.20 time: 0.085076 Oct 27 14:14:25.309244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 641/1024] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:25 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:25.434718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9d4f1ef1-e718-47e7-9ebb-b191562589ab tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:25.435483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9d4f1ef1-e718-47e7-9ebb-b191562589ab tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:25.442491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9d4f1ef1-e718-47e7-9ebb-b191562589ab tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:25.442942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9d4f1ef1-e718-47e7-9ebb-b191562589ab tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:25.443754 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9d4f1ef1-e718-47e7-9ebb-b191562589ab tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:25.444198 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9d4f1ef1-e718-47e7-9ebb-b191562589ab tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:25.567781 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9d4f1ef1-e718-47e7-9ebb-b191562589ab tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:25.575289 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9d4f1ef1-e718-47e7-9ebb-b191562589ab tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1546 microversion: 2.1 time: 0.145249 Oct 27 14:14:25.575853 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 642/1025] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:25 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1546 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:25.591357 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4249864d-a04e-4058-98c6-4028a02364d7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:25.591841 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4249864d-a04e-4058-98c6-4028a02364d7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:25.597945 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4249864d-a04e-4058-98c6-4028a02364d7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:25.598437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4249864d-a04e-4058-98c6-4028a02364d7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:25.599171 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4249864d-a04e-4058-98c6-4028a02364d7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:25.599607 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4249864d-a04e-4058-98c6-4028a02364d7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:25.686194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4249864d-a04e-4058-98c6-4028a02364d7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098724 Oct 27 14:14:25.686787 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 643/1026] 10.222.0.85 () {58 vars in 1274 bytes} [Wed Oct 27 14:14:25 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:14:26.238458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-11f0241a-b7b5-49fa-91e5-947f5086e399 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:26.239234 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-11f0241a-b7b5-49fa-91e5-947f5086e399 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:26.248336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11f0241a-b7b5-49fa-91e5-947f5086e399 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:26.248786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11f0241a-b7b5-49fa-91e5-947f5086e399 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:26.249584 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11f0241a-b7b5-49fa-91e5-947f5086e399 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:26.250020 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-11f0241a-b7b5-49fa-91e5-947f5086e399 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:26.490660 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-11f0241a-b7b5-49fa-91e5-947f5086e399 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:26.498539 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-11f0241a-b7b5-49fa-91e5-947f5086e399 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.264292 Oct 27 14:14:26.499368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 644/1027] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:26 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:26.510961 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1fa237f8-0142-4c3f-ad82-48ad5e63cd1f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:26.512163 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1fa237f8-0142-4c3f-ad82-48ad5e63cd1f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:26.518155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1fa237f8-0142-4c3f-ad82-48ad5e63cd1f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:26.518597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1fa237f8-0142-4c3f-ad82-48ad5e63cd1f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:26.519391 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1fa237f8-0142-4c3f-ad82-48ad5e63cd1f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:26.519820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1fa237f8-0142-4c3f-ad82-48ad5e63cd1f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:26.588197 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1fa237f8-0142-4c3f-ad82-48ad5e63cd1f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 14 microversion: 2.20 time: 0.087802 Oct 27 14:14:26.591905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 645/1028] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:26 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:26.680740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1b53d272-d583-4f88-9ac1-e233e4bc5fb2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:26.681736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1b53d272-d583-4f88-9ac1-e233e4bc5fb2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:26.688789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b53d272-d583-4f88-9ac1-e233e4bc5fb2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:26.689217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b53d272-d583-4f88-9ac1-e233e4bc5fb2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:26.690973 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b53d272-d583-4f88-9ac1-e233e4bc5fb2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:26.691459 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b53d272-d583-4f88-9ac1-e233e4bc5fb2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:26.755322 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1b53d272-d583-4f88-9ac1-e233e4bc5fb2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 14 microversion: 2.1 time: 0.078392 Oct 27 14:14:26.756024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 646/1029] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:26 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:27.516423 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e2106724-63f5-4afe-9553-5e1d6d17f18f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:27.517152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e2106724-63f5-4afe-9553-5e1d6d17f18f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:27.524664 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e2106724-63f5-4afe-9553-5e1d6d17f18f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:27.525111 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e2106724-63f5-4afe-9553-5e1d6d17f18f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:27.525895 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e2106724-63f5-4afe-9553-5e1d6d17f18f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:27.526326 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e2106724-63f5-4afe-9553-5e1d6d17f18f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:27.661549 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e2106724-63f5-4afe-9553-5e1d6d17f18f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:27.669519 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e2106724-63f5-4afe-9553-5e1d6d17f18f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.157804 Oct 27 14:14:27.670091 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 647/1030] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:27 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:27.683395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f0d3e958-d1dc-48de-a81e-80df248d1fff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:27.684492 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f0d3e958-d1dc-48de-a81e-80df248d1fff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:27.690534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0d3e958-d1dc-48de-a81e-80df248d1fff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:27.690983 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0d3e958-d1dc-48de-a81e-80df248d1fff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:27.691820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0d3e958-d1dc-48de-a81e-80df248d1fff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:27.692257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0d3e958-d1dc-48de-a81e-80df248d1fff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:27.770569 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f0d3e958-d1dc-48de-a81e-80df248d1fff tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 14 microversion: 2.20 time: 0.090653 Oct 27 14:14:27.771383 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 648/1031] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:27 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:27.776155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7811e255-deab-4540-9df5-6df7ad06ed95 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:27.777294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7811e255-deab-4540-9df5-6df7ad06ed95 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:27.784809 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7811e255-deab-4540-9df5-6df7ad06ed95 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:27.785253 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7811e255-deab-4540-9df5-6df7ad06ed95 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:27.786017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7811e255-deab-4540-9df5-6df7ad06ed95 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:27.786451 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7811e255-deab-4540-9df5-6df7ad06ed95 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:27.849174 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7811e255-deab-4540-9df5-6df7ad06ed95 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 14 microversion: 2.1 time: 0.076538 Oct 27 14:14:27.849838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 649/1032] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:27 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:28.686384 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f0704332-0ce4-4469-bfca-0133828e6e8f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:28.687066 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f0704332-0ce4-4469-bfca-0133828e6e8f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:28.694028 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0704332-0ce4-4469-bfca-0133828e6e8f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:28.695613 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0704332-0ce4-4469-bfca-0133828e6e8f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:28.695613 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0704332-0ce4-4469-bfca-0133828e6e8f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:28.695815 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0704332-0ce4-4469-bfca-0133828e6e8f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:28.823346 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f0704332-0ce4-4469-bfca-0133828e6e8f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:28.831373 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f0704332-0ce4-4469-bfca-0133828e6e8f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.149231 Oct 27 14:14:28.831943 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 650/1033] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:28 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:28.836401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5d781d31-22f4-4295-8f72-715981af45bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:28.837295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5d781d31-22f4-4295-8f72-715981af45bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:28.843769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5d781d31-22f4-4295-8f72-715981af45bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:28.844217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5d781d31-22f4-4295-8f72-715981af45bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:28.844985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5d781d31-22f4-4295-8f72-715981af45bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:28.845457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5d781d31-22f4-4295-8f72-715981af45bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:28.911896 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5d781d31-22f4-4295-8f72-715981af45bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 14 microversion: 2.20 time: 0.078627 Oct 27 14:14:28.912426 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 651/1034] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:28 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:28.917288 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-aa82f1be-ecdd-4ce2-b63e-c26927e176ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:28.919054 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-aa82f1be-ecdd-4ce2-b63e-c26927e176ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:28.925868 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aa82f1be-ecdd-4ce2-b63e-c26927e176ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:28.926317 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aa82f1be-ecdd-4ce2-b63e-c26927e176ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:28.927082 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aa82f1be-ecdd-4ce2-b63e-c26927e176ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:28.927546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-aa82f1be-ecdd-4ce2-b63e-c26927e176ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:28.994531 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-aa82f1be-ecdd-4ce2-b63e-c26927e176ea tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 14 microversion: 2.1 time: 0.080765 Oct 27 14:14:28.995153 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 652/1035] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:28 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:29.002199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-234eb2a3-0b38-49f4-b9fa-7e31d029e437 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2071530249"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:29.002814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-234eb2a3-0b38-49f4-b9fa-7e31d029e437 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:29.009654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-234eb2a3-0b38-49f4-b9fa-7e31d029e437 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:29.010100 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-234eb2a3-0b38-49f4-b9fa-7e31d029e437 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:29.010866 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-234eb2a3-0b38-49f4-b9fa-7e31d029e437 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:29.011346 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-234eb2a3-0b38-49f4-b9fa-7e31d029e437 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:29.131438 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.network.security_group_api [None req-234eb2a3-0b38-49f4-b9fa-7e31d029e437 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Removing security group cd50fbfa-f142-4652-8802-f751ca5456e6 from port d7dbd7ad-d681-4b28-a600-73b66f728573 Oct 27 14:14:29.473158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-234eb2a3-0b38-49f4-b9fa-7e31d029e437 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "POST /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.474724 Oct 27 14:14:29.478635 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 653/1036] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:28 2021] POST /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:29.849250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c064821c-11eb-451a-9379-d09f981f0ec1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:29.849899 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c064821c-11eb-451a-9379-d09f981f0ec1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:29.857752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c064821c-11eb-451a-9379-d09f981f0ec1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:29.858206 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c064821c-11eb-451a-9379-d09f981f0ec1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:29.858992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c064821c-11eb-451a-9379-d09f981f0ec1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:29.859529 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c064821c-11eb-451a-9379-d09f981f0ec1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:30.349132 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c064821c-11eb-451a-9379-d09f981f0ec1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:30.356934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c064821c-11eb-451a-9379-d09f981f0ec1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.511813 Oct 27 14:14:30.357633 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 654/1037] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:29 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:30.362151 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0012e497-a602-441f-807a-0208cda59049 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:30.363117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0012e497-a602-441f-807a-0208cda59049 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:30.368939 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0012e497-a602-441f-807a-0208cda59049 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:30.369386 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0012e497-a602-441f-807a-0208cda59049 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:30.370156 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0012e497-a602-441f-807a-0208cda59049 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:30.370589 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0012e497-a602-441f-807a-0208cda59049 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:30.436165 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0012e497-a602-441f-807a-0208cda59049 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 14 microversion: 2.20 time: 0.077232 Oct 27 14:14:30.439478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 655/1038] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:30 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:30.442043 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-44b9f444-1729-472d-ac10-b1102524f5b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:30.443091 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-44b9f444-1729-472d-ac10-b1102524f5b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:30.450413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44b9f444-1729-472d-ac10-b1102524f5b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:30.450850 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44b9f444-1729-472d-ac10-b1102524f5b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:30.451648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44b9f444-1729-472d-ac10-b1102524f5b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:30.452080 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-44b9f444-1729-472d-ac10-b1102524f5b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:30.524547 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-44b9f444-1729-472d-ac10-b1102524f5b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 14 microversion: 2.1 time: 0.086104 Oct 27 14:14:30.526002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 656/1039] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:30 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:30.876893 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-08af2337-6a85-4e60-9a03-4998251550fc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:30.877507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-08af2337-6a85-4e60-9a03-4998251550fc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:30.884062 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-08af2337-6a85-4e60-9a03-4998251550fc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:30.884504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-08af2337-6a85-4e60-9a03-4998251550fc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:30.885273 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-08af2337-6a85-4e60-9a03-4998251550fc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:30.885710 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-08af2337-6a85-4e60-9a03-4998251550fc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:30.967268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-08af2337-6a85-4e60-9a03-4998251550fc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lazy-loading 'services' on Instance uuid 8d115154-f737-44a1-83d0-3ed7b44ab9f5 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:14:31.051410 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-08af2337-6a85-4e60-9a03-4998251550fc tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/os-volume_attachments/00363ed4-575a-4cfb-aeb5-2318e1b8b8c9" status: 202 len: 0 microversion: 2.1 time: 0.178834 Oct 27 14:14:31.052386 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 657/1040] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:14:30 2021] DELETE /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/os-volume_attachments/00363ed4-575a-4cfb-aeb5-2318e1b8b8c9 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:31.061766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b0bdaf3f-b30d-409b-8437-1981afab8221 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:31.062832 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b0bdaf3f-b30d-409b-8437-1981afab8221 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:31.069310 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b0bdaf3f-b30d-409b-8437-1981afab8221 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:31.069783 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b0bdaf3f-b30d-409b-8437-1981afab8221 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:31.070800 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b0bdaf3f-b30d-409b-8437-1981afab8221 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:31.071368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b0bdaf3f-b30d-409b-8437-1981afab8221 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:31.104549 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b0bdaf3f-b30d-409b-8437-1981afab8221 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047509 Oct 27 14:14:31.105159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 658/1041] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:14:31 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:14:31.373684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-80d5654a-263f-43dd-be5f-8fd7336d60b2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:31.374329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-80d5654a-263f-43dd-be5f-8fd7336d60b2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:31.380628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80d5654a-263f-43dd-be5f-8fd7336d60b2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:31.381075 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80d5654a-263f-43dd-be5f-8fd7336d60b2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:31.381846 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80d5654a-263f-43dd-be5f-8fd7336d60b2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:31.382280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-80d5654a-263f-43dd-be5f-8fd7336d60b2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:31.512452 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-80d5654a-263f-43dd-be5f-8fd7336d60b2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:31.519973 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-80d5654a-263f-43dd-be5f-8fd7336d60b2 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.150055 Oct 27 14:14:31.520535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 659/1042] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:31 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:31.524902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cddab00a-b28e-4f03-be94-2782c2fae42f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:31.525798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cddab00a-b28e-4f03-be94-2782c2fae42f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:31.532462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cddab00a-b28e-4f03-be94-2782c2fae42f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:31.532901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cddab00a-b28e-4f03-be94-2782c2fae42f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:31.533676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cddab00a-b28e-4f03-be94-2782c2fae42f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:31.534102 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cddab00a-b28e-4f03-be94-2782c2fae42f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:31.601017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cddab00a-b28e-4f03-be94-2782c2fae42f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 14 microversion: 2.20 time: 0.079239 Oct 27 14:14:31.604199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 660/1043] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:31 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:31.606779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b3b183dc-3c9f-430c-bf07-200ecc777c0d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:31.607848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b3b183dc-3c9f-430c-bf07-200ecc777c0d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:31.614635 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3b183dc-3c9f-430c-bf07-200ecc777c0d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:31.615075 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3b183dc-3c9f-430c-bf07-200ecc777c0d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:31.615858 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3b183dc-3c9f-430c-bf07-200ecc777c0d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:31.616285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3b183dc-3c9f-430c-bf07-200ecc777c0d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:31.687530 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b3b183dc-3c9f-430c-bf07-200ecc777c0d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 14 microversion: 2.1 time: 0.084342 Oct 27 14:14:31.688245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 661/1044] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:31 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:32.117894 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3754a142-f26b-4b3f-bf7f-1a888f6f681d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:32.118792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3754a142-f26b-4b3f-bf7f-1a888f6f681d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:32.126338 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3754a142-f26b-4b3f-bf7f-1a888f6f681d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:32.126785 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3754a142-f26b-4b3f-bf7f-1a888f6f681d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:32.127592 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3754a142-f26b-4b3f-bf7f-1a888f6f681d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:32.128022 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3754a142-f26b-4b3f-bf7f-1a888f6f681d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:32.157145 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3754a142-f26b-4b3f-bf7f-1a888f6f681d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043510 Oct 27 14:14:32.157709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 662/1045] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:14:32 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 14:14:32.166864 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ffcafc7a-73e7-4ee0-8b7a-a7b3bac82a6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:32.167389 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ffcafc7a-73e7-4ee0-8b7a-a7b3bac82a6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:32.173907 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ffcafc7a-73e7-4ee0-8b7a-a7b3bac82a6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:32.174352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ffcafc7a-73e7-4ee0-8b7a-a7b3bac82a6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:32.175117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ffcafc7a-73e7-4ee0-8b7a-a7b3bac82a6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:32.175581 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ffcafc7a-73e7-4ee0-8b7a-a7b3bac82a6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:32.250891 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-ffcafc7a-73e7-4ee0-8b7a-a7b3bac82a6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] HTTP exception thrown: Instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 is not attached to volume 00363ed4-575a-4cfb-aeb5-2318e1b8b8c9 Oct 27 14:14:32.251535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ffcafc7a-73e7-4ee0-8b7a-a7b3bac82a6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Returning 404 to user: Instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 is not attached to volume 00363ed4-575a-4cfb-aeb5-2318e1b8b8c9 {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:14:32.252369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ffcafc7a-73e7-4ee0-8b7a-a7b3bac82a6d tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/os-volume_attachments/00363ed4-575a-4cfb-aeb5-2318e1b8b8c9" status: 404 len: 154 microversion: 2.1 time: 0.089016 Oct 27 14:14:32.252936 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 663/1046] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:14:32 2021] DELETE /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5/os-volume_attachments/00363ed4-575a-4cfb-aeb5-2318e1b8b8c9 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:14:32.537243 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-63d0bf9e-8a3c-4ee6-8566-cc118feb6953 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:32.537851 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-63d0bf9e-8a3c-4ee6-8566-cc118feb6953 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:32.545178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-63d0bf9e-8a3c-4ee6-8566-cc118feb6953 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:32.545666 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-63d0bf9e-8a3c-4ee6-8566-cc118feb6953 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:32.546438 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-63d0bf9e-8a3c-4ee6-8566-cc118feb6953 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:32.546875 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-63d0bf9e-8a3c-4ee6-8566-cc118feb6953 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:32.673366 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-63d0bf9e-8a3c-4ee6-8566-cc118feb6953 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:32.680786 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-63d0bf9e-8a3c-4ee6-8566-cc118feb6953 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.147612 Oct 27 14:14:32.681337 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 664/1047] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:32 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:32.686294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5a3debc3-d64f-4d51-ae25-bbd7474542c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:32.687204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5a3debc3-d64f-4d51-ae25-bbd7474542c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:32.693334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5a3debc3-d64f-4d51-ae25-bbd7474542c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:32.693790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5a3debc3-d64f-4d51-ae25-bbd7474542c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:32.694766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5a3debc3-d64f-4d51-ae25-bbd7474542c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:32.695377 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5a3debc3-d64f-4d51-ae25-bbd7474542c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:32.781984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5a3debc3-d64f-4d51-ae25-bbd7474542c6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 2333 microversion: 2.20 time: 0.099417 Oct 27 14:14:32.782604 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 665/1048] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:32 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 2333 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:14:32.787561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8d2e0fd3-13d3-40f2-9591-63ba512c748b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:32.788544 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8d2e0fd3-13d3-40f2-9591-63ba512c748b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:32.795468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8d2e0fd3-13d3-40f2-9591-63ba512c748b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:32.795913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8d2e0fd3-13d3-40f2-9591-63ba512c748b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:32.796678 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8d2e0fd3-13d3-40f2-9591-63ba512c748b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:32.797110 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8d2e0fd3-13d3-40f2-9591-63ba512c748b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:32.862515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8d2e0fd3-13d3-40f2-9591-63ba512c748b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 14 microversion: 2.1 time: 0.078521 Oct 27 14:14:32.863142 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 666/1049] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:32 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:33.380429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1c0f9dce-4433-448f-861b-b3e3bcd02f79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:33.381050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1c0f9dce-4433-448f-861b-b3e3bcd02f79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:33.388788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c0f9dce-4433-448f-861b-b3e3bcd02f79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:33.389237 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c0f9dce-4433-448f-861b-b3e3bcd02f79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:33.390006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c0f9dce-4433-448f-861b-b3e3bcd02f79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:33.390439 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c0f9dce-4433-448f-861b-b3e3bcd02f79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:33.415365 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1c0f9dce-4433-448f-861b-b3e3bcd02f79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:14:33.493498 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1c0f9dce-4433-448f-861b-b3e3bcd02f79 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 204 len: 0 microversion: 2.1 time: 0.116896 Oct 27 14:14:33.494157 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 667/1050] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:14:33 2021] DELETE /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:14:33.504653 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7e6f72eb-d005-4da3-9d1a-71eb2746d345 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:33.505586 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7e6f72eb-d005-4da3-9d1a-71eb2746d345 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:33.512107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e6f72eb-d005-4da3-9d1a-71eb2746d345 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:33.512661 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e6f72eb-d005-4da3-9d1a-71eb2746d345 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:33.513527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e6f72eb-d005-4da3-9d1a-71eb2746d345 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:33.514056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7e6f72eb-d005-4da3-9d1a-71eb2746d345 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:33.642281 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7e6f72eb-d005-4da3-9d1a-71eb2746d345 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:33.650050 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7e6f72eb-d005-4da3-9d1a-71eb2746d345 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1674 microversion: 2.1 time: 0.150861 Oct 27 14:14:33.650625 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 668/1051] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:33 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:33.697581 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-42b064b4-d0e0-4bf6-979c-80d6bb8e64c6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:33.698185 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-42b064b4-d0e0-4bf6-979c-80d6bb8e64c6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:33.705235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-42b064b4-d0e0-4bf6-979c-80d6bb8e64c6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:33.705673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-42b064b4-d0e0-4bf6-979c-80d6bb8e64c6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:33.706438 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-42b064b4-d0e0-4bf6-979c-80d6bb8e64c6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:33.706864 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-42b064b4-d0e0-4bf6-979c-80d6bb8e64c6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:33.838010 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-42b064b4-d0e0-4bf6-979c-80d6bb8e64c6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:33.845326 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-42b064b4-d0e0-4bf6-979c-80d6bb8e64c6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.151420 Oct 27 14:14:33.846162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 669/1052] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:33 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:33.850547 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cbfb1ea3-4423-4417-8048-6ec843c9b2f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:33.851522 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cbfb1ea3-4423-4417-8048-6ec843c9b2f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:33.857271 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbfb1ea3-4423-4417-8048-6ec843c9b2f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:33.857747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbfb1ea3-4423-4417-8048-6ec843c9b2f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:33.858514 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbfb1ea3-4423-4417-8048-6ec843c9b2f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:33.858947 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cbfb1ea3-4423-4417-8048-6ec843c9b2f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:33.950894 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cbfb1ea3-4423-4417-8048-6ec843c9b2f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 11929 microversion: 2.20 time: 0.103386 Oct 27 14:14:33.951500 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 670/1053] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:33 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 11929 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:14:33.956790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-365af2d5-0a6e-4e20-a6de-1dd376f86712 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:33.957779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-365af2d5-0a6e-4e20-a6de-1dd376f86712 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:33.964631 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-365af2d5-0a6e-4e20-a6de-1dd376f86712 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:33.965096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-365af2d5-0a6e-4e20-a6de-1dd376f86712 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:33.965886 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-365af2d5-0a6e-4e20-a6de-1dd376f86712 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:33.966318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-365af2d5-0a6e-4e20-a6de-1dd376f86712 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:34.046955 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-365af2d5-0a6e-4e20-a6de-1dd376f86712 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 14 microversion: 2.1 time: 0.094064 Oct 27 14:14:34.047936 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 671/1054] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:33 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:34.668503 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-753c4f62-24d3-45f5-a092-df5d3b47927a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:34.669354 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-753c4f62-24d3-45f5-a092-df5d3b47927a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:34.676337 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-753c4f62-24d3-45f5-a092-df5d3b47927a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:34.676780 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-753c4f62-24d3-45f5-a092-df5d3b47927a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:34.677532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-753c4f62-24d3-45f5-a092-df5d3b47927a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:34.677956 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-753c4f62-24d3-45f5-a092-df5d3b47927a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:34.800225 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-753c4f62-24d3-45f5-a092-df5d3b47927a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:34.807526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-753c4f62-24d3-45f5-a092-df5d3b47927a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1674 microversion: 2.1 time: 0.143102 Oct 27 14:14:34.808092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 672/1055] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:34 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1674 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:34.861430 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b8d0ebbd-cfa9-47a9-8778-e242504071e7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:34.862070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b8d0ebbd-cfa9-47a9-8778-e242504071e7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:34.868360 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b8d0ebbd-cfa9-47a9-8778-e242504071e7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:34.868804 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b8d0ebbd-cfa9-47a9-8778-e242504071e7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:34.869564 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b8d0ebbd-cfa9-47a9-8778-e242504071e7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:34.869994 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b8d0ebbd-cfa9-47a9-8778-e242504071e7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:34.991605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b8d0ebbd-cfa9-47a9-8778-e242504071e7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:35.000056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b8d0ebbd-cfa9-47a9-8778-e242504071e7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.142174 Oct 27 14:14:35.000621 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 673/1056] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:34 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:35.004999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c484558e-5762-4e3d-a7f7-48f3985034f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:35.005895 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c484558e-5762-4e3d-a7f7-48f3985034f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:35.012039 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c484558e-5762-4e3d-a7f7-48f3985034f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:35.012356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c484558e-5762-4e3d-a7f7-48f3985034f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:35.013174 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c484558e-5762-4e3d-a7f7-48f3985034f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:35.013608 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c484558e-5762-4e3d-a7f7-48f3985034f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:35.089718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c484558e-5762-4e3d-a7f7-48f3985034f8 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 16877 microversion: 2.20 time: 0.087857 Oct 27 14:14:35.090369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 674/1057] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:35 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 16877 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:14:35.095405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-17f180f5-ff4d-4586-9dac-83890ac2d92f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:35.096387 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-17f180f5-ff4d-4586-9dac-83890ac2d92f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:35.103190 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-17f180f5-ff4d-4586-9dac-83890ac2d92f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:35.103639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-17f180f5-ff4d-4586-9dac-83890ac2d92f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:35.104397 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-17f180f5-ff4d-4586-9dac-83890ac2d92f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:35.104826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-17f180f5-ff4d-4586-9dac-83890ac2d92f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:35.177887 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-17f180f5-ff4d-4586-9dac-83890ac2d92f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 14 microversion: 2.1 time: 0.086046 Oct 27 14:14:35.180155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 675/1058] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:35 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:35.302873 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-16bfc78d-480d-4ba6-aa1b-6d9d67c2ba29 req-e2978447-84c3-43df-a186-8cef214fc9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42f6751-6bd2-4fd8-bce3-06d68f746b23", "name": "network-vif-plugged", "status": "completed", "tag": "5820d118-3b01-4edb-be39-b49d0e1eee59"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:35.304464 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:14:35.304464 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:14:35.313086 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-16bfc78d-480d-4ba6-aa1b-6d9d67c2ba29 req-e2978447-84c3-43df-a186-8cef214fc9aa service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:35.313600 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-16bfc78d-480d-4ba6-aa1b-6d9d67c2ba29 req-e2978447-84c3-43df-a186-8cef214fc9aa service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:35.324944 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-16bfc78d-480d-4ba6-aa1b-6d9d67c2ba29 req-e2978447-84c3-43df-a186-8cef214fc9aa service nova] Creating event network-vif-plugged:5820d118-3b01-4edb-be39-b49d0e1eee59 for instance d42f6751-6bd2-4fd8-bce3-06d68f746b23 on hv-cinder-81566 Oct 27 14:14:35.330722 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-16bfc78d-480d-4ba6-aa1b-6d9d67c2ba29 req-e2978447-84c3-43df-a186-8cef214fc9aa service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 Oct 27 14:14:35.331345 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 676/1059] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:14:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:14:35.826583 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fe8c7e6e-ef0f-43ab-9174-2579bc24f684 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:35.827303 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fe8c7e6e-ef0f-43ab-9174-2579bc24f684 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:35.833586 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe8c7e6e-ef0f-43ab-9174-2579bc24f684 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:35.834030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe8c7e6e-ef0f-43ab-9174-2579bc24f684 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:35.834795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe8c7e6e-ef0f-43ab-9174-2579bc24f684 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:35.835268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe8c7e6e-ef0f-43ab-9174-2579bc24f684 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:35.999219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fe8c7e6e-ef0f-43ab-9174-2579bc24f684 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:36.006735 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fe8c7e6e-ef0f-43ab-9174-2579bc24f684 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1674 microversion: 2.1 time: 0.185183 Oct 27 14:14:36.007335 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 677/1060] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:35 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:36.016681 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2a59695e-f892-4d88-8f37-62e171e0e5dd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:36.017294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2a59695e-f892-4d88-8f37-62e171e0e5dd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:36.023321 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a59695e-f892-4d88-8f37-62e171e0e5dd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:36.023773 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a59695e-f892-4d88-8f37-62e171e0e5dd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:36.024621 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a59695e-f892-4d88-8f37-62e171e0e5dd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:36.025017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a59695e-f892-4d88-8f37-62e171e0e5dd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:36.233272 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2a59695e-f892-4d88-8f37-62e171e0e5dd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:36.241889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2a59695e-f892-4d88-8f37-62e171e0e5dd tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1265 microversion: 2.1 time: 0.228634 Oct 27 14:14:36.242470 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 678/1061] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:36 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:36.247359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b8f5bb4f-7a35-4871-9a74-078024e6f5ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:36.248285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b8f5bb4f-7a35-4871-9a74-078024e6f5ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:36.254382 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b8f5bb4f-7a35-4871-9a74-078024e6f5ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:36.254862 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b8f5bb4f-7a35-4871-9a74-078024e6f5ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:36.255677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b8f5bb4f-7a35-4871-9a74-078024e6f5ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:36.256108 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b8f5bb4f-7a35-4871-9a74-078024e6f5ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:36.337973 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b8f5bb4f-7a35-4871-9a74-078024e6f5ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 18102 microversion: 2.20 time: 0.094270 Oct 27 14:14:36.342319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 679/1062] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:36 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 18102 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:14:36.344299 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b3844b3b-1e24-4445-84c8-dd886f6eeff7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:36.345296 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b3844b3b-1e24-4445-84c8-dd886f6eeff7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:36.352814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3844b3b-1e24-4445-84c8-dd886f6eeff7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:36.353268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3844b3b-1e24-4445-84c8-dd886f6eeff7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:36.354060 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3844b3b-1e24-4445-84c8-dd886f6eeff7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:36.354499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b3844b3b-1e24-4445-84c8-dd886f6eeff7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:36.438806 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b3844b3b-1e24-4445-84c8-dd886f6eeff7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 14 microversion: 2.1 time: 0.098261 Oct 27 14:14:36.441998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 680/1063] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:36 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:37.025041 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:37.025682 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:37.033205 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.033658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.034431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.034865 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.068188 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.068576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.069027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lazy-loading 'fault' on Instance uuid 8d115154-f737-44a1-83d0-3ed7b44ab9f5 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:14:37.111074 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7033d1e2bc6a42b88f6e06cd17251b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb32c18000f440e88bc81eec30692b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:37.119146 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d8f7ef09-847f-4a61-97fb-01333f1b091a tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 200 len: 1349 microversion: 2.1 time: 0.098312 Oct 27 14:14:37.120011 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 681/1064] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:37 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:37.259746 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1b26a07f-664d-40de-87de-6d06958cee4a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:37.260352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1b26a07f-664d-40de-87de-6d06958cee4a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:37.267578 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b26a07f-664d-40de-87de-6d06958cee4a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.268300 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b26a07f-664d-40de-87de-6d06958cee4a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.269086 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b26a07f-664d-40de-87de-6d06958cee4a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.269510 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b26a07f-664d-40de-87de-6d06958cee4a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.397206 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1b26a07f-664d-40de-87de-6d06958cee4a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:37.405379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1b26a07f-664d-40de-87de-6d06958cee4a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1451 microversion: 2.1 time: 0.149501 Oct 27 14:14:37.405950 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 682/1065] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:37 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:37.410297 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-84cf6bde-ddcc-48b9-914d-56028622efed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:37.411220 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-84cf6bde-ddcc-48b9-914d-56028622efed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:37.416792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-84cf6bde-ddcc-48b9-914d-56028622efed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.417240 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-84cf6bde-ddcc-48b9-914d-56028622efed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.417998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-84cf6bde-ddcc-48b9-914d-56028622efed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.418429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-84cf6bde-ddcc-48b9-914d-56028622efed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.496537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-84cf6bde-ddcc-48b9-914d-56028622efed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 20490 microversion: 2.20 time: 0.089343 Oct 27 14:14:37.497175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 683/1066] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:37 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 20490 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:14:37.502768 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-090a6ed3-c6ad-48e4-9d45-61a329cc0069 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:37.503468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-090a6ed3-c6ad-48e4-9d45-61a329cc0069 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:37.510334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-090a6ed3-c6ad-48e4-9d45-61a329cc0069 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.510776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-090a6ed3-c6ad-48e4-9d45-61a329cc0069 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.511573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-090a6ed3-c6ad-48e4-9d45-61a329cc0069 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.512003 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-090a6ed3-c6ad-48e4-9d45-61a329cc0069 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.634967 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-090a6ed3-c6ad-48e4-9d45-61a329cc0069 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:14:37.643159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-090a6ed3-c6ad-48e4-9d45-61a329cc0069 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1451 microversion: 2.1 time: 0.143852 Oct 27 14:14:37.643739 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 684/1067] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:37 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:14:37.648109 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bb5e1248-2209-474d-a327-630d51c7e5f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:37.649006 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-bb5e1248-2209-474d-a327-630d51c7e5f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:37.655888 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bb5e1248-2209-474d-a327-630d51c7e5f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.656339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bb5e1248-2209-474d-a327-630d51c7e5f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.657118 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bb5e1248-2209-474d-a327-630d51c7e5f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:37.657551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bb5e1248-2209-474d-a327-630d51c7e5f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:37.724802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bb5e1248-2209-474d-a327-630d51c7e5f1 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 14 microversion: 2.1 time: 0.079578 Oct 27 14:14:37.725789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 685/1068] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:37 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 14:14:38.137015 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7ff93c96-0326-44df-8ec5-0cacbce806ac tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:38.137711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7ff93c96-0326-44df-8ec5-0cacbce806ac tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] [instance: 8d115154-f737-44a1-83d0-3ed7b44ab9f5] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:38.145484 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ff93c96-0326-44df-8ec5-0cacbce806ac tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:38.145929 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ff93c96-0326-44df-8ec5-0cacbce806ac tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:38.146705 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ff93c96-0326-44df-8ec5-0cacbce806ac tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:38.147155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ff93c96-0326-44df-8ec5-0cacbce806ac tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:38.162996 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-7ff93c96-0326-44df-8ec5-0cacbce806ac tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] HTTP exception thrown: Instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 could not be found. Oct 27 14:14:38.163614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7ff93c96-0326-44df-8ec5-0cacbce806ac tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Returning 404 to user: Instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:14:38.164449 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7ff93c96-0326-44df-8ec5-0cacbce806ac tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5" status: 404 len: 111 microversion: 2.1 time: 0.031654 Oct 27 14:14:38.165015 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 686/1069] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:14:38 2021] GET /compute/v2.1/servers/8d115154-f737-44a1-83d0-3ed7b44ab9f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:14:38.172898 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3fac32eb-0027-4b66-a966-da55f1c362e8 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] Calling method '.version_select at 0x7f4570ac8a60>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:14:38.191316 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3fac32eb-0027-4b66-a966-da55f1c362e8 tempest-TestMinimumBasicScenario-183567267 tempest-TestMinimumBasicScenario-183567267-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1423778766" status: 202 len: 0 microversion: 2.1 time: 0.021825 Oct 27 14:14:38.192056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 687/1070] 10.222.0.85 () {58 vars in 1271 bytes} [Wed Oct 27 14:14:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1423778766 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:38.508776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e94515b2-81c1-4370-85e2-5c3e3060f330 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:38.509768 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e94515b2-81c1-4370-85e2-5c3e3060f330 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:38.519091 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e94515b2-81c1-4370-85e2-5c3e3060f330 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:38.519809 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e94515b2-81c1-4370-85e2-5c3e3060f330 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:38.520747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e94515b2-81c1-4370-85e2-5c3e3060f330 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:38.521355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e94515b2-81c1-4370-85e2-5c3e3060f330 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:38.604105 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e94515b2-81c1-4370-85e2-5c3e3060f330 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 22707 microversion: 2.20 time: 0.099072 Oct 27 14:14:38.607495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 688/1071] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:38 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 22707 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:38.737473 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-eceba8db-0fda-4f46-a42f-98665df1951d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:38.739309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-eceba8db-0fda-4f46-a42f-98665df1951d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:38.748520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eceba8db-0fda-4f46-a42f-98665df1951d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:38.749324 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eceba8db-0fda-4f46-a42f-98665df1951d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:38.750333 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eceba8db-0fda-4f46-a42f-98665df1951d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:38.750990 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eceba8db-0fda-4f46-a42f-98665df1951d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:38.848396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-eceba8db-0fda-4f46-a42f-98665df1951d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 3463 microversion: 2.1 time: 0.115062 Oct 27 14:14:38.849478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 689/1072] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:38 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 3463 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:14:39.616658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1f807c86-8c99-43fd-8631-7e20662ecb80 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:39.619039 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1f807c86-8c99-43fd-8631-7e20662ecb80 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:39.629609 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1f807c86-8c99-43fd-8631-7e20662ecb80 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:39.630408 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1f807c86-8c99-43fd-8631-7e20662ecb80 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:39.632401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1f807c86-8c99-43fd-8631-7e20662ecb80 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:39.633149 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1f807c86-8c99-43fd-8631-7e20662ecb80 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:39.736526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1f807c86-8c99-43fd-8631-7e20662ecb80 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 23795 microversion: 2.20 time: 0.124003 Oct 27 14:14:39.740434 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 690/1073] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:39 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 23795 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:39.861132 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-427884ee-bd08-426e-828d-201bb975a86e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:39.862270 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-427884ee-bd08-426e-828d-201bb975a86e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:39.869377 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-427884ee-bd08-426e-828d-201bb975a86e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:39.870341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-427884ee-bd08-426e-828d-201bb975a86e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:39.870861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-427884ee-bd08-426e-828d-201bb975a86e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:39.871401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-427884ee-bd08-426e-828d-201bb975a86e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:39.969899 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-427884ee-bd08-426e-828d-201bb975a86e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 12613 microversion: 2.1 time: 0.113472 Oct 27 14:14:39.970814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 691/1074] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:39 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 12613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:40.749510 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b66af14d-fbea-408b-99e5-2f48ff0e855a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:40.751421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b66af14d-fbea-408b-99e5-2f48ff0e855a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:40.757932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b66af14d-fbea-408b-99e5-2f48ff0e855a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:40.758379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b66af14d-fbea-408b-99e5-2f48ff0e855a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:40.759171 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b66af14d-fbea-408b-99e5-2f48ff0e855a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:40.759616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b66af14d-fbea-408b-99e5-2f48ff0e855a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:40.840446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b66af14d-fbea-408b-99e5-2f48ff0e855a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 25147 microversion: 2.20 time: 0.095369 Oct 27 14:14:40.841666 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 692/1075] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:40 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 25147 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:40.981574 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e81b39e9-2dee-4f04-ae21-c4b9c6ef4f75 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:40.983312 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e81b39e9-2dee-4f04-ae21-c4b9c6ef4f75 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:40.991088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e81b39e9-2dee-4f04-ae21-c4b9c6ef4f75 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:40.991587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e81b39e9-2dee-4f04-ae21-c4b9c6ef4f75 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:40.992369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e81b39e9-2dee-4f04-ae21-c4b9c6ef4f75 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:40.992806 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e81b39e9-2dee-4f04-ae21-c4b9c6ef4f75 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:41.080397 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e81b39e9-2dee-4f04-ae21-c4b9c6ef4f75 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 18102 microversion: 2.1 time: 0.102268 Oct 27 14:14:41.081312 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 693/1076] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:40 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 18102 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:41.859505 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3f0225b4-56b0-41e4-9bb5-3e1d9ae8631f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:41.860572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3f0225b4-56b0-41e4-9bb5-3e1d9ae8631f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:41.870730 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f0225b4-56b0-41e4-9bb5-3e1d9ae8631f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:41.872687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f0225b4-56b0-41e4-9bb5-3e1d9ae8631f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:41.872687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f0225b4-56b0-41e4-9bb5-3e1d9ae8631f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:41.872687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3f0225b4-56b0-41e4-9bb5-3e1d9ae8631f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:41.974063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3f0225b4-56b0-41e4-9bb5-3e1d9ae8631f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 26275 microversion: 2.20 time: 0.124477 Oct 27 14:14:41.975466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 694/1077] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:41 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 26275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:14:42.094309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-135d5f7e-1b86-4838-bb1a-f4e11b3630f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:42.095691 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-135d5f7e-1b86-4838-bb1a-f4e11b3630f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:42.103230 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-135d5f7e-1b86-4838-bb1a-f4e11b3630f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:42.103815 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-135d5f7e-1b86-4838-bb1a-f4e11b3630f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:42.104717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-135d5f7e-1b86-4838-bb1a-f4e11b3630f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:42.105263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-135d5f7e-1b86-4838-bb1a-f4e11b3630f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:42.205380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-135d5f7e-1b86-4838-bb1a-f4e11b3630f2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 18305 microversion: 2.1 time: 0.112190 Oct 27 14:14:42.206077 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 695/1078] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:42 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 18305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:14:42.987454 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-85eee909-52da-4552-b90d-f1830da69d7d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:42.989164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-85eee909-52da-4552-b90d-f1830da69d7d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:42.996105 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85eee909-52da-4552-b90d-f1830da69d7d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:42.996546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85eee909-52da-4552-b90d-f1830da69d7d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:42.997307 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85eee909-52da-4552-b90d-f1830da69d7d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:42.997732 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-85eee909-52da-4552-b90d-f1830da69d7d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:43.088110 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-85eee909-52da-4552-b90d-f1830da69d7d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 27147 microversion: 2.20 time: 0.104449 Oct 27 14:14:43.088998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 696/1079] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:42 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 27147 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:43.216503 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-47a70f35-c26e-4d7c-8168-bb5887bcc992 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:43.217620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-47a70f35-c26e-4d7c-8168-bb5887bcc992 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:43.224431 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-47a70f35-c26e-4d7c-8168-bb5887bcc992 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:43.224878 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-47a70f35-c26e-4d7c-8168-bb5887bcc992 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:43.225647 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-47a70f35-c26e-4d7c-8168-bb5887bcc992 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:43.226077 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-47a70f35-c26e-4d7c-8168-bb5887bcc992 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:43.328332 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-47a70f35-c26e-4d7c-8168-bb5887bcc992 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 20189 microversion: 2.1 time: 0.115655 Oct 27 14:14:43.329674 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 697/1080] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:43 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 20189 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:44.100630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ac1e6c9c-0777-44eb-9173-8d684f3d7aea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:44.102318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ac1e6c9c-0777-44eb-9173-8d684f3d7aea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:44.109642 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ac1e6c9c-0777-44eb-9173-8d684f3d7aea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:44.110495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ac1e6c9c-0777-44eb-9173-8d684f3d7aea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:44.111500 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ac1e6c9c-0777-44eb-9173-8d684f3d7aea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:44.112120 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ac1e6c9c-0777-44eb-9173-8d684f3d7aea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:44.203625 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ac1e6c9c-0777-44eb-9173-8d684f3d7aea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 27682 microversion: 2.20 time: 0.107114 Oct 27 14:14:44.204578 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 698/1081] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:44 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 27682 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:14:44.340705 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-df8e841b-261e-41cf-be0e-858caeb852d2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:44.342633 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-df8e841b-261e-41cf-be0e-858caeb852d2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:44.349650 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df8e841b-261e-41cf-be0e-858caeb852d2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:44.350227 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df8e841b-261e-41cf-be0e-858caeb852d2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:44.351088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df8e841b-261e-41cf-be0e-858caeb852d2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:44.351546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-df8e841b-261e-41cf-be0e-858caeb852d2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:44.447345 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-df8e841b-261e-41cf-be0e-858caeb852d2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 22546 microversion: 2.1 time: 0.110736 Oct 27 14:14:44.448647 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 699/1082] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:44 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 22546 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:14:45.219234 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dafc9ef6-c512-4faa-8cff-fc84091b2dcd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:45.220770 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dafc9ef6-c512-4faa-8cff-fc84091b2dcd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:45.228097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dafc9ef6-c512-4faa-8cff-fc84091b2dcd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:45.229005 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dafc9ef6-c512-4faa-8cff-fc84091b2dcd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:45.229797 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dafc9ef6-c512-4faa-8cff-fc84091b2dcd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:45.230284 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dafc9ef6-c512-4faa-8cff-fc84091b2dcd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:45.321660 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dafc9ef6-c512-4faa-8cff-fc84091b2dcd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 28023 microversion: 2.20 time: 0.108771 Oct 27 14:14:45.324424 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 700/1083] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:45 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 28023 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:45.465615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ef25c11e-1850-42b7-9be0-7fa77942cd87 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:45.468945 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ef25c11e-1850-42b7-9be0-7fa77942cd87 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:45.483031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef25c11e-1850-42b7-9be0-7fa77942cd87 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:45.483765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef25c11e-1850-42b7-9be0-7fa77942cd87 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:45.484942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef25c11e-1850-42b7-9be0-7fa77942cd87 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:45.485062 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ef25c11e-1850-42b7-9be0-7fa77942cd87 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:45.589645 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ef25c11e-1850-42b7-9be0-7fa77942cd87 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 23803 microversion: 2.1 time: 0.134036 Oct 27 14:14:45.593608 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 701/1084] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:45 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 23803 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:46.336026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1db1a1da-8f13-4982-9a5d-163bc651e79b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:46.337199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1db1a1da-8f13-4982-9a5d-163bc651e79b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:46.344782 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1db1a1da-8f13-4982-9a5d-163bc651e79b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:46.345314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1db1a1da-8f13-4982-9a5d-163bc651e79b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:46.346089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1db1a1da-8f13-4982-9a5d-163bc651e79b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:46.346533 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1db1a1da-8f13-4982-9a5d-163bc651e79b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:46.444032 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1db1a1da-8f13-4982-9a5d-163bc651e79b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 28212 microversion: 2.20 time: 0.111844 Oct 27 14:14:46.444989 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 702/1085] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:46 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 28212 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:14:46.601172 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ea249121-287a-45ad-8774-d894ac77ef5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:46.602206 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ea249121-287a-45ad-8774-d894ac77ef5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:46.609120 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ea249121-287a-45ad-8774-d894ac77ef5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:46.609572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ea249121-287a-45ad-8774-d894ac77ef5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:46.610348 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ea249121-287a-45ad-8774-d894ac77ef5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:46.610780 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ea249121-287a-45ad-8774-d894ac77ef5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:46.704538 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ea249121-287a-45ad-8774-d894ac77ef5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 25273 microversion: 2.1 time: 0.107252 Oct 27 14:14:46.708527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 703/1086] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:46 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 25273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:14:47.456978 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-78a50e3c-70cd-47d9-8fa2-036eef5fa473 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:47.457969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-78a50e3c-70cd-47d9-8fa2-036eef5fa473 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:47.465337 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-78a50e3c-70cd-47d9-8fa2-036eef5fa473 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:47.465817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-78a50e3c-70cd-47d9-8fa2-036eef5fa473 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:47.466596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-78a50e3c-70cd-47d9-8fa2-036eef5fa473 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:47.467761 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-78a50e3c-70cd-47d9-8fa2-036eef5fa473 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:47.539044 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-78a50e3c-70cd-47d9-8fa2-036eef5fa473 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 28212 microversion: 2.20 time: 0.086028 Oct 27 14:14:47.539723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 704/1087] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:47 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 28212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:47.716970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3fe309d4-23b4-4f6b-8435-06eaf1b9e922 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:47.717908 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3fe309d4-23b4-4f6b-8435-06eaf1b9e922 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:47.724769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3fe309d4-23b4-4f6b-8435-06eaf1b9e922 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:47.725313 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3fe309d4-23b4-4f6b-8435-06eaf1b9e922 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:47.726082 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3fe309d4-23b4-4f6b-8435-06eaf1b9e922 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:47.726510 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3fe309d4-23b4-4f6b-8435-06eaf1b9e922 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:47.813923 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3fe309d4-23b4-4f6b-8435-06eaf1b9e922 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 26174 microversion: 2.1 time: 0.100971 Oct 27 14:14:47.814577 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 705/1088] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:47 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 26174 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:48.550885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4e038c82-8321-4598-824f-aa06e479034b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:48.552041 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4e038c82-8321-4598-824f-aa06e479034b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:48.559183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4e038c82-8321-4598-824f-aa06e479034b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:48.559628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4e038c82-8321-4598-824f-aa06e479034b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:48.560406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4e038c82-8321-4598-824f-aa06e479034b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:48.561535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4e038c82-8321-4598-824f-aa06e479034b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:48.645017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4e038c82-8321-4598-824f-aa06e479034b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 28503 microversion: 2.20 time: 0.097982 Oct 27 14:14:48.645900 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 706/1089] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:48 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 28503 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:14:48.826138 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4a8f6dcc-7ac3-4a2d-bd56-0771b6721625 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:48.827855 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4a8f6dcc-7ac3-4a2d-bd56-0771b6721625 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:48.834700 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4a8f6dcc-7ac3-4a2d-bd56-0771b6721625 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:48.835149 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4a8f6dcc-7ac3-4a2d-bd56-0771b6721625 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:48.835926 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4a8f6dcc-7ac3-4a2d-bd56-0771b6721625 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:48.836363 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4a8f6dcc-7ac3-4a2d-bd56-0771b6721625 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:48.921343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4a8f6dcc-7ac3-4a2d-bd56-0771b6721625 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 27065 microversion: 2.1 time: 0.099185 Oct 27 14:14:48.921984 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 707/1090] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:48 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 27065 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:49.657789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ed9e0fbb-a90e-45a3-a2ac-02623fe13bf9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:49.658776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ed9e0fbb-a90e-45a3-a2ac-02623fe13bf9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:49.665603 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ed9e0fbb-a90e-45a3-a2ac-02623fe13bf9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:49.666043 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ed9e0fbb-a90e-45a3-a2ac-02623fe13bf9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:49.666794 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ed9e0fbb-a90e-45a3-a2ac-02623fe13bf9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:49.667253 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ed9e0fbb-a90e-45a3-a2ac-02623fe13bf9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:49.757421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ed9e0fbb-a90e-45a3-a2ac-02623fe13bf9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 28670 microversion: 2.20 time: 0.104150 Oct 27 14:14:49.758070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 708/1091] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:49 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 28670 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:49.933697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a74b8044-8998-4657-ac7e-303d8abc9d50 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:49.934695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a74b8044-8998-4657-ac7e-303d8abc9d50 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:49.941660 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74b8044-8998-4657-ac7e-303d8abc9d50 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:49.942112 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74b8044-8998-4657-ac7e-303d8abc9d50 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:49.942871 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74b8044-8998-4657-ac7e-303d8abc9d50 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:49.943343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a74b8044-8998-4657-ac7e-303d8abc9d50 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:50.031353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a74b8044-8998-4657-ac7e-303d8abc9d50 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 27576 microversion: 2.1 time: 0.101597 Oct 27 14:14:50.032550 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 709/1092] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:49 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 27576 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:50.770890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7ebad1b7-2b4c-49a9-ada7-4ca5cfd6c10f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:50.771852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7ebad1b7-2b4c-49a9-ada7-4ca5cfd6c10f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:50.778711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ebad1b7-2b4c-49a9-ada7-4ca5cfd6c10f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:50.779183 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ebad1b7-2b4c-49a9-ada7-4ca5cfd6c10f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:50.780683 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ebad1b7-2b4c-49a9-ada7-4ca5cfd6c10f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:50.781117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7ebad1b7-2b4c-49a9-ada7-4ca5cfd6c10f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:50.855628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7ebad1b7-2b4c-49a9-ada7-4ca5cfd6c10f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 28670 microversion: 2.20 time: 0.089005 Oct 27 14:14:50.856512 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 710/1093] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:50 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 28670 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:51.043750 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-21632529-e2e7-41f5-aed0-cac30f35d845 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:51.044673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-21632529-e2e7-41f5-aed0-cac30f35d845 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:51.052133 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-21632529-e2e7-41f5-aed0-cac30f35d845 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:51.052571 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-21632529-e2e7-41f5-aed0-cac30f35d845 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:51.053323 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-21632529-e2e7-41f5-aed0-cac30f35d845 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:51.053751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-21632529-e2e7-41f5-aed0-cac30f35d845 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:51.143352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-21632529-e2e7-41f5-aed0-cac30f35d845 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 27823 microversion: 2.1 time: 0.103529 Oct 27 14:14:51.144259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 711/1094] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:51 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 27823 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:51.867967 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4433ad98-0b0f-4cd1-a184-8a2da948923e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:51.868985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4433ad98-0b0f-4cd1-a184-8a2da948923e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:51.876301 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4433ad98-0b0f-4cd1-a184-8a2da948923e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:51.876776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4433ad98-0b0f-4cd1-a184-8a2da948923e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:51.877530 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4433ad98-0b0f-4cd1-a184-8a2da948923e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:51.877961 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4433ad98-0b0f-4cd1-a184-8a2da948923e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:51.953039 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4433ad98-0b0f-4cd1-a184-8a2da948923e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 28670 microversion: 2.20 time: 0.088791 Oct 27 14:14:51.953854 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 712/1095] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:51 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 28670 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:52.155026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b60456ed-41dc-434f-a6a3-501f68320415 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:52.156076 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b60456ed-41dc-434f-a6a3-501f68320415 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:52.162910 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b60456ed-41dc-434f-a6a3-501f68320415 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:52.163551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b60456ed-41dc-434f-a6a3-501f68320415 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:52.164311 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b60456ed-41dc-434f-a6a3-501f68320415 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:52.164741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b60456ed-41dc-434f-a6a3-501f68320415 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:52.261122 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b60456ed-41dc-434f-a6a3-501f68320415 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 28183 microversion: 2.1 time: 0.110143 Oct 27 14:14:52.261983 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 713/1096] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:52 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 28183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:52.965671 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d8dd0ffc-930b-4273-9a44-1a70a9ee2b97 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:52.966587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d8dd0ffc-930b-4273-9a44-1a70a9ee2b97 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:52.973650 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8dd0ffc-930b-4273-9a44-1a70a9ee2b97 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:52.974085 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8dd0ffc-930b-4273-9a44-1a70a9ee2b97 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:52.974835 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8dd0ffc-930b-4273-9a44-1a70a9ee2b97 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:52.975298 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8dd0ffc-930b-4273-9a44-1a70a9ee2b97 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:53.050514 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d8dd0ffc-930b-4273-9a44-1a70a9ee2b97 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 28670 microversion: 2.20 time: 0.088806 Oct 27 14:14:53.051460 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 714/1097] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:52 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 28670 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:53.273394 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f920ac80-a9cf-4685-83be-273fd3e1826b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:53.274360 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f920ac80-a9cf-4685-83be-273fd3e1826b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:53.282614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f920ac80-a9cf-4685-83be-273fd3e1826b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:53.283065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f920ac80-a9cf-4685-83be-273fd3e1826b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:53.283873 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f920ac80-a9cf-4685-83be-273fd3e1826b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:53.284343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f920ac80-a9cf-4685-83be-273fd3e1826b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:53.361466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f920ac80-a9cf-4685-83be-273fd3e1826b tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 28183 microversion: 2.1 time: 0.092328 Oct 27 14:14:53.362353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 715/1098] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:53 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 28183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:54.062551 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a696479f-435c-4895-a59c-58a0fd2b933d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:54.063488 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a696479f-435c-4895-a59c-58a0fd2b933d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:54.070457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a696479f-435c-4895-a59c-58a0fd2b933d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:54.070897 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a696479f-435c-4895-a59c-58a0fd2b933d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:54.071706 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a696479f-435c-4895-a59c-58a0fd2b933d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:54.072141 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a696479f-435c-4895-a59c-58a0fd2b933d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:54.143525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a696479f-435c-4895-a59c-58a0fd2b933d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 28670 microversion: 2.20 time: 0.085006 Oct 27 14:14:54.144437 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 716/1099] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:54 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 28670 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:54.373826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-daf47153-75a7-4713-a16e-6b36223e280f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:54.374849 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-daf47153-75a7-4713-a16e-6b36223e280f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:54.381763 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-daf47153-75a7-4713-a16e-6b36223e280f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:54.382203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-daf47153-75a7-4713-a16e-6b36223e280f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:54.382961 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-daf47153-75a7-4713-a16e-6b36223e280f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:54.383419 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-daf47153-75a7-4713-a16e-6b36223e280f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:54.472244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-daf47153-75a7-4713-a16e-6b36223e280f tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 28473 microversion: 2.1 time: 0.102314 Oct 27 14:14:54.472887 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 717/1100] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:54 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 28473 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:55.156084 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-302784d6-2c5a-4945-8699-491a1a002f09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:55.157089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-302784d6-2c5a-4945-8699-491a1a002f09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:55.163919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-302784d6-2c5a-4945-8699-491a1a002f09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:55.164359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-302784d6-2c5a-4945-8699-491a1a002f09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:55.165114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-302784d6-2c5a-4945-8699-491a1a002f09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:55.165541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-302784d6-2c5a-4945-8699-491a1a002f09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:55.254000 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-302784d6-2c5a-4945-8699-491a1a002f09 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 29681 microversion: 2.20 time: 0.101934 Oct 27 14:14:55.254663 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 718/1101] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:55 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 29681 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:55.485271 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-060be98b-3338-47f1-bf57-b1c753b20d79 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:55.486185 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-060be98b-3338-47f1-bf57-b1c753b20d79 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:55.493134 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-060be98b-3338-47f1-bf57-b1c753b20d79 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:55.493583 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-060be98b-3338-47f1-bf57-b1c753b20d79 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:55.494351 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-060be98b-3338-47f1-bf57-b1c753b20d79 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:55.494788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-060be98b-3338-47f1-bf57-b1c753b20d79 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:55.585876 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-060be98b-3338-47f1-bf57-b1c753b20d79 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 28578 microversion: 2.1 time: 0.105163 Oct 27 14:14:55.586531 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 719/1102] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:55 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 28578 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:56.267004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f981a2a7-4575-4cfd-8741-d94093616b01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:56.268026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f981a2a7-4575-4cfd-8741-d94093616b01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:56.275094 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f981a2a7-4575-4cfd-8741-d94093616b01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:56.275572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f981a2a7-4575-4cfd-8741-d94093616b01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:56.276342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f981a2a7-4575-4cfd-8741-d94093616b01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:56.276777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f981a2a7-4575-4cfd-8741-d94093616b01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:56.361355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f981a2a7-4575-4cfd-8741-d94093616b01 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 31400 microversion: 2.20 time: 0.098995 Oct 27 14:14:56.362033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 720/1103] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:56 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 31400 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:56.598265 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ca732974-d8d6-4bf7-a9b3-84121952be26 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:56.599232 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ca732974-d8d6-4bf7-a9b3-84121952be26 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:56.606117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ca732974-d8d6-4bf7-a9b3-84121952be26 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:56.606555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ca732974-d8d6-4bf7-a9b3-84121952be26 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:56.607355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ca732974-d8d6-4bf7-a9b3-84121952be26 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:56.607785 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ca732974-d8d6-4bf7-a9b3-84121952be26 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:56.698733 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ca732974-d8d6-4bf7-a9b3-84121952be26 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 28641 microversion: 2.1 time: 0.105135 Oct 27 14:14:56.699414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 721/1104] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:56 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 28641 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:57.373792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-061db47d-2f1a-43eb-8357-e634682d63e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:57.374770 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-061db47d-2f1a-43eb-8357-e634682d63e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:57.382478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-061db47d-2f1a-43eb-8357-e634682d63e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:57.382916 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-061db47d-2f1a-43eb-8357-e634682d63e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:57.383706 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-061db47d-2f1a-43eb-8357-e634682d63e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:57.384134 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-061db47d-2f1a-43eb-8357-e634682d63e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:57.467357 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-061db47d-2f1a-43eb-8357-e634682d63e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 32296 microversion: 2.20 time: 0.097415 Oct 27 14:14:57.471594 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 722/1105] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:57 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 32296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:57.710860 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f0436fd0-0d3d-49c1-b0d6-ab9533ae3c4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:57.711901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f0436fd0-0d3d-49c1-b0d6-ab9533ae3c4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:57.719223 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0436fd0-0d3d-49c1-b0d6-ab9533ae3c4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:57.719952 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0436fd0-0d3d-49c1-b0d6-ab9533ae3c4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:57.720759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0436fd0-0d3d-49c1-b0d6-ab9533ae3c4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:57.721192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0436fd0-0d3d-49c1-b0d6-ab9533ae3c4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:57.789179 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f0436fd0-0d3d-49c1-b0d6-ab9533ae3c4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 28641 microversion: 2.1 time: 0.082708 Oct 27 14:14:57.790143 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 723/1106] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:57 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 28641 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:58.480497 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e5690403-a43d-4783-a005-e0733bb7c72c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:58.481497 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e5690403-a43d-4783-a005-e0733bb7c72c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:58.488585 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5690403-a43d-4783-a005-e0733bb7c72c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:58.489314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5690403-a43d-4783-a005-e0733bb7c72c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:58.490686 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5690403-a43d-4783-a005-e0733bb7c72c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:58.491380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e5690403-a43d-4783-a005-e0733bb7c72c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:58.581899 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e5690403-a43d-4783-a005-e0733bb7c72c tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 33089 microversion: 2.20 time: 0.105585 Oct 27 14:14:58.582548 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 724/1107] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:58 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 33089 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:58.800396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-009dcf50-1f9f-4817-a821-548705b2ed4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:58.801950 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-009dcf50-1f9f-4817-a821-548705b2ed4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:58.809045 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-009dcf50-1f9f-4817-a821-548705b2ed4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:58.809520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-009dcf50-1f9f-4817-a821-548705b2ed4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:58.810298 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-009dcf50-1f9f-4817-a821-548705b2ed4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:58.810738 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-009dcf50-1f9f-4817-a821-548705b2ed4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:58.880243 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-009dcf50-1f9f-4817-a821-548705b2ed4a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 28641 microversion: 2.1 time: 0.083880 Oct 27 14:14:58.881114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 725/1108] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:58 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 28641 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:14:59.594867 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f0ebab86-34b0-487f-a2a7-882a9205a42d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:59.596061 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f0ebab86-34b0-487f-a2a7-882a9205a42d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:59.602928 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0ebab86-34b0-487f-a2a7-882a9205a42d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:59.603406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0ebab86-34b0-487f-a2a7-882a9205a42d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:59.604182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0ebab86-34b0-487f-a2a7-882a9205a42d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:59.604619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f0ebab86-34b0-487f-a2a7-882a9205a42d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:59.684714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f0ebab86-34b0-487f-a2a7-882a9205a42d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 33716 microversion: 2.20 time: 0.094354 Oct 27 14:14:59.685375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 726/1109] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:14:59 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 33716 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:14:59.893257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a4d319d5-6c40-4a15-b9d0-8f759d93942c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:14:59.894504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a4d319d5-6c40-4a15-b9d0-8f759d93942c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:14:59.901292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4d319d5-6c40-4a15-b9d0-8f759d93942c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:59.901729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4d319d5-6c40-4a15-b9d0-8f759d93942c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:59.902482 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4d319d5-6c40-4a15-b9d0-8f759d93942c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:14:59.902913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4d319d5-6c40-4a15-b9d0-8f759d93942c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:14:59.986255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a4d319d5-6c40-4a15-b9d0-8f759d93942c tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 28641 microversion: 2.1 time: 0.097734 Oct 27 14:14:59.986901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 727/1110] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:14:59 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 28641 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:00.697520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-561f3835-2600-431a-9126-cb14e4012071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:00.698441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-561f3835-2600-431a-9126-cb14e4012071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:00.705649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-561f3835-2600-431a-9126-cb14e4012071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:00.706092 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-561f3835-2600-431a-9126-cb14e4012071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:00.706863 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-561f3835-2600-431a-9126-cb14e4012071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:00.707336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-561f3835-2600-431a-9126-cb14e4012071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:00.791257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-561f3835-2600-431a-9126-cb14e4012071 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 34847 microversion: 2.20 time: 0.097749 Oct 27 14:15:00.792212 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 728/1111] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:15:00 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 34847 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:15:00.998722 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c0786781-da6b-46ee-a456-720e16ee2b84 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:00.999654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c0786781-da6b-46ee-a456-720e16ee2b84 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:01.006670 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0786781-da6b-46ee-a456-720e16ee2b84 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:01.007118 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0786781-da6b-46ee-a456-720e16ee2b84 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:01.007916 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0786781-da6b-46ee-a456-720e16ee2b84 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:01.008353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c0786781-da6b-46ee-a456-720e16ee2b84 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:01.090148 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c0786781-da6b-46ee-a456-720e16ee2b84 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 28641 microversion: 2.1 time: 0.095453 Oct 27 14:15:01.090801 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 729/1112] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:00 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 28641 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:01.803866 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4f19b0d7-9dfd-4e08-8108-dde9a335fe15 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:01.804848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4f19b0d7-9dfd-4e08-8108-dde9a335fe15 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:01.811759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f19b0d7-9dfd-4e08-8108-dde9a335fe15 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:01.812196 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f19b0d7-9dfd-4e08-8108-dde9a335fe15 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:01.813474 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f19b0d7-9dfd-4e08-8108-dde9a335fe15 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:01.813880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4f19b0d7-9dfd-4e08-8108-dde9a335fe15 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:01.907100 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4f19b0d7-9dfd-4e08-8108-dde9a335fe15 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 35917 microversion: 2.20 time: 0.107069 Oct 27 14:15:01.907729 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 730/1113] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:15:01 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 35917 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:15:02.101979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fe7a3a2a-d040-4532-a8fd-a55645765e29 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:02.102979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fe7a3a2a-d040-4532-a8fd-a55645765e29 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:02.110421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe7a3a2a-d040-4532-a8fd-a55645765e29 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:02.110950 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe7a3a2a-d040-4532-a8fd-a55645765e29 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:02.111811 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe7a3a2a-d040-4532-a8fd-a55645765e29 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:02.112248 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe7a3a2a-d040-4532-a8fd-a55645765e29 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:02.201999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fe7a3a2a-d040-4532-a8fd-a55645765e29 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 30015 microversion: 2.1 time: 0.102221 Oct 27 14:15:02.203217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 731/1114] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:02 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 30015 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:02.919706 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9b880728-4e27-48b2-bb9a-e2d63cd5e6cc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:02.920636 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9b880728-4e27-48b2-bb9a-e2d63cd5e6cc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:02.927662 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b880728-4e27-48b2-bb9a-e2d63cd5e6cc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:02.928100 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b880728-4e27-48b2-bb9a-e2d63cd5e6cc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:02.928852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b880728-4e27-48b2-bb9a-e2d63cd5e6cc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:02.929277 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b880728-4e27-48b2-bb9a-e2d63cd5e6cc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:03.020147 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9b880728-4e27-48b2-bb9a-e2d63cd5e6cc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 36910 microversion: 2.20 time: 0.104088 Oct 27 14:15:03.020800 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 732/1115] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:15:02 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 36910 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:15:03.214532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-63e9a007-c324-4502-8ebc-ad931105e98e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:03.215500 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-63e9a007-c324-4502-8ebc-ad931105e98e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:03.222982 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-63e9a007-c324-4502-8ebc-ad931105e98e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:03.223458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-63e9a007-c324-4502-8ebc-ad931105e98e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:03.224232 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-63e9a007-c324-4502-8ebc-ad931105e98e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:03.224667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-63e9a007-c324-4502-8ebc-ad931105e98e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:03.320693 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-63e9a007-c324-4502-8ebc-ad931105e98e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 31540 microversion: 2.1 time: 0.110187 Oct 27 14:15:03.321347 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 733/1116] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:03 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 31540 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:04.032570 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-dec684ff-d757-405c-9a93-e25a5f74b953 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:04.033486 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-dec684ff-d757-405c-9a93-e25a5f74b953 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:04.040375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dec684ff-d757-405c-9a93-e25a5f74b953 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:04.040827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dec684ff-d757-405c-9a93-e25a5f74b953 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:04.041595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dec684ff-d757-405c-9a93-e25a5f74b953 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:04.042026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-dec684ff-d757-405c-9a93-e25a5f74b953 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:04.137066 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-dec684ff-d757-405c-9a93-e25a5f74b953 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 37928 microversion: 2.20 time: 0.108682 Oct 27 14:15:04.137714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 734/1117] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:15:04 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 37928 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:15:04.333975 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9e6f17d8-9f23-498d-ae44-8da21083609a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:04.334900 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9e6f17d8-9f23-498d-ae44-8da21083609a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:04.342010 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9e6f17d8-9f23-498d-ae44-8da21083609a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:04.342457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9e6f17d8-9f23-498d-ae44-8da21083609a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:04.343259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9e6f17d8-9f23-498d-ae44-8da21083609a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:04.343695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9e6f17d8-9f23-498d-ae44-8da21083609a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:04.430547 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9e6f17d8-9f23-498d-ae44-8da21083609a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 32756 microversion: 2.1 time: 0.100572 Oct 27 14:15:04.431370 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 735/1118] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:04 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 32756 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:05.149858 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f8193722-bbc0-4443-86a9-ab8b23c396bc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:05.150835 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f8193722-bbc0-4443-86a9-ab8b23c396bc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:05.158432 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f8193722-bbc0-4443-86a9-ab8b23c396bc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:05.158822 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f8193722-bbc0-4443-86a9-ab8b23c396bc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:05.159610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f8193722-bbc0-4443-86a9-ab8b23c396bc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:05.160035 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f8193722-bbc0-4443-86a9-ab8b23c396bc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:05.247576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f8193722-bbc0-4443-86a9-ab8b23c396bc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 38214 microversion: 2.20 time: 0.101525 Oct 27 14:15:05.248272 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 736/1119] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:15:05 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 38214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:15:05.443805 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fca7d491-c88e-438d-96c2-2b1cb78373a2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:05.444714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fca7d491-c88e-438d-96c2-2b1cb78373a2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:05.451559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fca7d491-c88e-438d-96c2-2b1cb78373a2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:05.452010 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fca7d491-c88e-438d-96c2-2b1cb78373a2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:05.452771 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fca7d491-c88e-438d-96c2-2b1cb78373a2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:05.453202 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fca7d491-c88e-438d-96c2-2b1cb78373a2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:05.540578 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fca7d491-c88e-438d-96c2-2b1cb78373a2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 33467 microversion: 2.1 time: 0.100813 Oct 27 14:15:05.541226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 737/1120] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:05 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 33467 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:06.026812 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:15:06.027411 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Wed Oct 27 14:15:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Oct 27 14:15:06.261299 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-39691aaf-0747-4daf-8eb3-92a95c8a26ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:06.262216 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-39691aaf-0747-4daf-8eb3-92a95c8a26ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:06.270078 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39691aaf-0747-4daf-8eb3-92a95c8a26ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:06.270525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39691aaf-0747-4daf-8eb3-92a95c8a26ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:06.271336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39691aaf-0747-4daf-8eb3-92a95c8a26ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:06.271775 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39691aaf-0747-4daf-8eb3-92a95c8a26ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:06.341761 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-39691aaf-0747-4daf-8eb3-92a95c8a26ed tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 38214 microversion: 2.20 time: 0.084437 Oct 27 14:15:06.342677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 738/1121] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:15:06 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 38214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:15:06.553876 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f8548700-517d-44cb-a25a-6abf0a50bb42 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:06.554784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f8548700-517d-44cb-a25a-6abf0a50bb42 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:06.561697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f8548700-517d-44cb-a25a-6abf0a50bb42 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:06.562138 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f8548700-517d-44cb-a25a-6abf0a50bb42 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:06.562902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f8548700-517d-44cb-a25a-6abf0a50bb42 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:06.564020 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f8548700-517d-44cb-a25a-6abf0a50bb42 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:06.648803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f8548700-517d-44cb-a25a-6abf0a50bb42 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 34278 microversion: 2.1 time: 0.098950 Oct 27 14:15:06.649481 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 739/1122] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:06 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 34278 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:07.354282 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6989540b-53d4-4a31-9fb5-8d4c3ce3eaba tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:07.355344 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6989540b-53d4-4a31-9fb5-8d4c3ce3eaba tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:07.362900 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6989540b-53d4-4a31-9fb5-8d4c3ce3eaba tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:07.363375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6989540b-53d4-4a31-9fb5-8d4c3ce3eaba tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:07.364136 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6989540b-53d4-4a31-9fb5-8d4c3ce3eaba tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:07.364567 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6989540b-53d4-4a31-9fb5-8d4c3ce3eaba tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:07.451308 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6989540b-53d4-4a31-9fb5-8d4c3ce3eaba tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 200 len: 38355 microversion: 2.20 time: 0.100868 Oct 27 14:15:07.451967 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 740/1123] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:15:07 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 38355 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:15:07.462855 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-db0338af-7c92-4391-88bb-6c0127dcc5cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:07.463476 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-db0338af-7c92-4391-88bb-6c0127dcc5cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:07.470882 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-db0338af-7c92-4391-88bb-6c0127dcc5cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:07.471362 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-db0338af-7c92-4391-88bb-6c0127dcc5cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:07.472126 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-db0338af-7c92-4391-88bb-6c0127dcc5cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:07.472562 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-db0338af-7c92-4391-88bb-6c0127dcc5cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:07.496563 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-db0338af-7c92-4391-88bb-6c0127dcc5cf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/ips" status: 200 len: 153 microversion: 2.20 time: 0.038016 Oct 27 14:15:07.497133 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 741/1124] 10.222.0.85 () {60 vars in 1288 bytes} [Wed Oct 27 14:15:07 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:07.660600 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-747db947-849b-41b6-9699-e7eec01c991e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:07.661544 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-747db947-849b-41b6-9699-e7eec01c991e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:07.668226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-747db947-849b-41b6-9699-e7eec01c991e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:07.668568 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-747db947-849b-41b6-9699-e7eec01c991e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:07.669335 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-747db947-849b-41b6-9699-e7eec01c991e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:07.669760 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-747db947-849b-41b6-9699-e7eec01c991e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:07.763477 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-747db947-849b-41b6-9699-e7eec01c991e tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 35228 microversion: 2.1 time: 0.106901 Oct 27 14:15:07.764139 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 742/1125] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:07 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 35228 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:15:08.776591 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c14850ea-9025-4d21-b1b0-911080b6e470 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:08.777668 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c14850ea-9025-4d21-b1b0-911080b6e470 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:08.785327 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c14850ea-9025-4d21-b1b0-911080b6e470 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:08.785778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c14850ea-9025-4d21-b1b0-911080b6e470 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:08.786555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c14850ea-9025-4d21-b1b0-911080b6e470 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:08.786991 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c14850ea-9025-4d21-b1b0-911080b6e470 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:08.873610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c14850ea-9025-4d21-b1b0-911080b6e470 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 36513 microversion: 2.1 time: 0.100948 Oct 27 14:15:08.874255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 743/1126] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:08 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 36513 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:09.690606 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cf92a04e-8ada-49f6-a419-35e56639c151 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:09.691154 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cf92a04e-8ada-49f6-a419-35e56639c151 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:09.698055 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf92a04e-8ada-49f6-a419-35e56639c151 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:09.698501 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf92a04e-8ada-49f6-a419-35e56639c151 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:09.699314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf92a04e-8ada-49f6-a419-35e56639c151 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:09.699769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf92a04e-8ada-49f6-a419-35e56639c151 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:09.723262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-cf92a04e-8ada-49f6-a419-35e56639c151 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lazy-loading 'flavor' on Instance uuid e2e905cb-2edf-4221-933f-a7c59abcd554 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:15:09.994585 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cf92a04e-8ada-49f6-a419-35e56639c151 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 202 len: 0 microversion: 2.20 time: 0.308753 Oct 27 14:15:09.995296 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 744/1127] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:15:09 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:15:10.000192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f4a5583b-f40f-416d-8eb2-80df887b4254 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:10.001233 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f4a5583b-f40f-416d-8eb2-80df887b4254 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:10.008074 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4a5583b-f40f-416d-8eb2-80df887b4254 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:10.008659 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4a5583b-f40f-416d-8eb2-80df887b4254 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:10.009306 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4a5583b-f40f-416d-8eb2-80df887b4254 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:10.009770 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f4a5583b-f40f-416d-8eb2-80df887b4254 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:10.110356 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f4a5583b-f40f-416d-8eb2-80df887b4254 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 37973 microversion: 2.1 time: 0.113708 Oct 27 14:15:10.111017 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 745/1128] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:09 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 37973 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 14:15:10.116032 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-92621ae2-28d7-4fe4-81cf-a67b5991dd3f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:10.116723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-92621ae2-28d7-4fe4-81cf-a67b5991dd3f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:10.123573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92621ae2-28d7-4fe4-81cf-a67b5991dd3f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:10.124023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92621ae2-28d7-4fe4-81cf-a67b5991dd3f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:10.124789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92621ae2-28d7-4fe4-81cf-a67b5991dd3f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:10.125223 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92621ae2-28d7-4fe4-81cf-a67b5991dd3f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:10.249820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-92621ae2-28d7-4fe4-81cf-a67b5991dd3f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:10.258658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-92621ae2-28d7-4fe4-81cf-a67b5991dd3f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:10.260174 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-92621ae2-28d7-4fe4-81cf-a67b5991dd3f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:10.261430 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-92621ae2-28d7-4fe4-81cf-a67b5991dd3f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.149218 Oct 27 14:15:10.261985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 746/1129] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:10 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:11.122405 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-46ea2beb-d144-4457-91d5-af7e94a3e731 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:11.123395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-46ea2beb-d144-4457-91d5-af7e94a3e731 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:11.130557 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-46ea2beb-d144-4457-91d5-af7e94a3e731 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:11.130997 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-46ea2beb-d144-4457-91d5-af7e94a3e731 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:11.131788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-46ea2beb-d144-4457-91d5-af7e94a3e731 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:11.132220 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-46ea2beb-d144-4457-91d5-af7e94a3e731 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:11.210082 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-46ea2beb-d144-4457-91d5-af7e94a3e731 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 38160 microversion: 2.1 time: 0.091180 Oct 27 14:15:11.210721 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 747/1130] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:11 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 38160 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:11.281169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d0e4a488-f9bc-449b-8530-43cd45c7bdb6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:11.282366 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d0e4a488-f9bc-449b-8530-43cd45c7bdb6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:11.289539 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d0e4a488-f9bc-449b-8530-43cd45c7bdb6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:11.289991 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d0e4a488-f9bc-449b-8530-43cd45c7bdb6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:11.290760 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d0e4a488-f9bc-449b-8530-43cd45c7bdb6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:11.291218 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d0e4a488-f9bc-449b-8530-43cd45c7bdb6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:11.413790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d0e4a488-f9bc-449b-8530-43cd45c7bdb6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:11.421550 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d0e4a488-f9bc-449b-8530-43cd45c7bdb6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:11.423691 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d0e4a488-f9bc-449b-8530-43cd45c7bdb6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:11.424848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d0e4a488-f9bc-449b-8530-43cd45c7bdb6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.147768 Oct 27 14:15:11.425400 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 748/1131] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:11 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:12.222591 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cf6c1add-0490-4d79-8591-97f2b39a26d3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:12.223532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cf6c1add-0490-4d79-8591-97f2b39a26d3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:12.230069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf6c1add-0490-4d79-8591-97f2b39a26d3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:12.230514 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf6c1add-0490-4d79-8591-97f2b39a26d3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:12.231336 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf6c1add-0490-4d79-8591-97f2b39a26d3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:12.231768 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cf6c1add-0490-4d79-8591-97f2b39a26d3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:12.300965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cf6c1add-0490-4d79-8591-97f2b39a26d3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 38160 microversion: 2.1 time: 0.082017 Oct 27 14:15:12.301635 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 749/1132] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:12 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 38160 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:12.444401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-125235ad-dbd1-4b42-99dc-9e9957916524 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:12.445096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-125235ad-dbd1-4b42-99dc-9e9957916524 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:12.452137 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-125235ad-dbd1-4b42-99dc-9e9957916524 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:12.452586 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-125235ad-dbd1-4b42-99dc-9e9957916524 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:12.453354 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-125235ad-dbd1-4b42-99dc-9e9957916524 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:12.453808 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-125235ad-dbd1-4b42-99dc-9e9957916524 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:12.574745 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-125235ad-dbd1-4b42-99dc-9e9957916524 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:12.582566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-125235ad-dbd1-4b42-99dc-9e9957916524 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:12.584142 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-125235ad-dbd1-4b42-99dc-9e9957916524 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:12.585256 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-125235ad-dbd1-4b42-99dc-9e9957916524 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.145075 Oct 27 14:15:12.585814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 750/1133] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:12 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:13.312845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f00e61be-86a7-47ce-8877-ff0f81cc8ec3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:13.313790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f00e61be-86a7-47ce-8877-ff0f81cc8ec3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:13.320279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f00e61be-86a7-47ce-8877-ff0f81cc8ec3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:13.320714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f00e61be-86a7-47ce-8877-ff0f81cc8ec3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:13.321468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f00e61be-86a7-47ce-8877-ff0f81cc8ec3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:13.321894 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f00e61be-86a7-47ce-8877-ff0f81cc8ec3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:13.388529 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f00e61be-86a7-47ce-8877-ff0f81cc8ec3 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 38160 microversion: 2.1 time: 0.079208 Oct 27 14:15:13.389168 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 751/1134] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:13 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 38160 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:13.603004 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4fd2072b-09e9-450b-ac0f-d1ea83a8034e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:13.603717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4fd2072b-09e9-450b-ac0f-d1ea83a8034e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:13.610601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fd2072b-09e9-450b-ac0f-d1ea83a8034e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:13.611058 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fd2072b-09e9-450b-ac0f-d1ea83a8034e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:13.611831 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fd2072b-09e9-450b-ac0f-d1ea83a8034e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:13.612260 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fd2072b-09e9-450b-ac0f-d1ea83a8034e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:13.737096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4fd2072b-09e9-450b-ac0f-d1ea83a8034e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:13.745274 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4fd2072b-09e9-450b-ac0f-d1ea83a8034e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:13.746773 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4fd2072b-09e9-450b-ac0f-d1ea83a8034e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:13.747963 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4fd2072b-09e9-450b-ac0f-d1ea83a8034e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.149026 Oct 27 14:15:13.748517 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 752/1135] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:13 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:14.401338 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1d1bcbfd-a814-4a38-9af3-50d44a27edc7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:14.402276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1d1bcbfd-a814-4a38-9af3-50d44a27edc7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:14.409269 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d1bcbfd-a814-4a38-9af3-50d44a27edc7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:14.409715 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d1bcbfd-a814-4a38-9af3-50d44a27edc7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:14.410479 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d1bcbfd-a814-4a38-9af3-50d44a27edc7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:14.410905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d1bcbfd-a814-4a38-9af3-50d44a27edc7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:14.492580 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1d1bcbfd-a814-4a38-9af3-50d44a27edc7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action" status: 200 len: 38287 microversion: 2.1 time: 0.094732 Oct 27 14:15:14.493230 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 753/1136] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:14 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/action => generated 38287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:14.503820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d19883cc-cfbf-4943-80ef-c7d437eab5aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:14.504376 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d19883cc-cfbf-4943-80ef-c7d437eab5aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:14.511182 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d19883cc-cfbf-4943-80ef-c7d437eab5aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:14.511614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d19883cc-cfbf-4943-80ef-c7d437eab5aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:14.512375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d19883cc-cfbf-4943-80ef-c7d437eab5aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:14.512800 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d19883cc-cfbf-4943-80ef-c7d437eab5aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:14.536774 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d19883cc-cfbf-4943-80ef-c7d437eab5aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/ips" status: 200 len: 105 microversion: 2.1 time: 0.037018 Oct 27 14:15:14.537347 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 754/1137] 10.222.0.85 () {58 vars in 1247 bytes} [Wed Oct 27 14:15:14 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/ips => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:15:14.765916 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5c0d5a7d-46d5-4420-a180-448b229888b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:14.767595 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5c0d5a7d-46d5-4420-a180-448b229888b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:14.774153 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c0d5a7d-46d5-4420-a180-448b229888b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:14.774676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c0d5a7d-46d5-4420-a180-448b229888b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:14.775566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c0d5a7d-46d5-4420-a180-448b229888b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:14.776076 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c0d5a7d-46d5-4420-a180-448b229888b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:14.904272 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5c0d5a7d-46d5-4420-a180-448b229888b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:14.913168 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5c0d5a7d-46d5-4420-a180-448b229888b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:14.914638 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5c0d5a7d-46d5-4420-a180-448b229888b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:14.915839 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5c0d5a7d-46d5-4420-a180-448b229888b2 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.153820 Oct 27 14:15:14.916396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 755/1138] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:14 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:15.844499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f9a533d5-7d89-43a3-b66e-41767bd9ac03 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f72f23aa-b308-4f3b-b107-e89cc971d162"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:15.845804 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f9a533d5-7d89-43a3-b66e-41767bd9ac03 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:15.852439 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f9a533d5-7d89-43a3-b66e-41767bd9ac03 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:15.852881 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f9a533d5-7d89-43a3-b66e-41767bd9ac03 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:15.853644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f9a533d5-7d89-43a3-b66e-41767bd9ac03 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:15.854070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f9a533d5-7d89-43a3-b66e-41767bd9ac03 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:16.092593 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f9a533d5-7d89-43a3-b66e-41767bd9ac03 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251536 Oct 27 14:15:16.093159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 756/1139] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:15:15 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:15:16.100840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8c499a80-7cda-42a3-9d6a-25bca302500a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:16.101665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8c499a80-7cda-42a3-9d6a-25bca302500a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:16.108680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c499a80-7cda-42a3-9d6a-25bca302500a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:16.109142 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c499a80-7cda-42a3-9d6a-25bca302500a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:16.110527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c499a80-7cda-42a3-9d6a-25bca302500a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:16.110990 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8c499a80-7cda-42a3-9d6a-25bca302500a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:16.325346 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8c499a80-7cda-42a3-9d6a-25bca302500a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:16.333751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8c499a80-7cda-42a3-9d6a-25bca302500a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:16.335342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8c499a80-7cda-42a3-9d6a-25bca302500a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:16.336515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8c499a80-7cda-42a3-9d6a-25bca302500a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.242281 Oct 27 14:15:16.337070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 757/1140] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:16 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:17.355618 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b463a174-7df6-4806-b05c-4ecf63be54f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:17.356404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b463a174-7df6-4806-b05c-4ecf63be54f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:17.363566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b463a174-7df6-4806-b05c-4ecf63be54f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:17.364011 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b463a174-7df6-4806-b05c-4ecf63be54f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:17.364767 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b463a174-7df6-4806-b05c-4ecf63be54f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:17.365277 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b463a174-7df6-4806-b05c-4ecf63be54f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:17.485351 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b463a174-7df6-4806-b05c-4ecf63be54f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:17.494337 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b463a174-7df6-4806-b05c-4ecf63be54f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:17.495879 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b463a174-7df6-4806-b05c-4ecf63be54f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:17.497038 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b463a174-7df6-4806-b05c-4ecf63be54f5 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.145309 Oct 27 14:15:17.497597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 758/1141] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:17 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:18.515388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-75473818-0920-421a-a8ab-152ce3be62e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:18.516035 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-75473818-0920-421a-a8ab-152ce3be62e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:18.523060 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-75473818-0920-421a-a8ab-152ce3be62e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:18.523537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-75473818-0920-421a-a8ab-152ce3be62e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:18.524301 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-75473818-0920-421a-a8ab-152ce3be62e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:18.524737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-75473818-0920-421a-a8ab-152ce3be62e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:18.648401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-75473818-0920-421a-a8ab-152ce3be62e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:18.656231 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-75473818-0920-421a-a8ab-152ce3be62e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:18.658489 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-75473818-0920-421a-a8ab-152ce3be62e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:18.659716 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-75473818-0920-421a-a8ab-152ce3be62e9 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.148223 Oct 27 14:15:18.660273 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 759/1142] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:18 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:19.678741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9b0a1ab1-4287-4469-b4ee-eb26a86dd2b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:19.679395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9b0a1ab1-4287-4469-b4ee-eb26a86dd2b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:19.685710 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b0a1ab1-4287-4469-b4ee-eb26a86dd2b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:19.686153 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b0a1ab1-4287-4469-b4ee-eb26a86dd2b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:19.686919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b0a1ab1-4287-4469-b4ee-eb26a86dd2b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:19.687379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b0a1ab1-4287-4469-b4ee-eb26a86dd2b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:19.811289 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9b0a1ab1-4287-4469-b4ee-eb26a86dd2b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:19.819034 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9b0a1ab1-4287-4469-b4ee-eb26a86dd2b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:19.820557 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9b0a1ab1-4287-4469-b4ee-eb26a86dd2b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:19.821709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9b0a1ab1-4287-4469-b4ee-eb26a86dd2b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.146837 Oct 27 14:15:19.822261 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 760/1143] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:19 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:20.841086 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-04cd3a60-d01e-42ab-ab43-c323272b3527 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:20.841833 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-04cd3a60-d01e-42ab-ab43-c323272b3527 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:20.848133 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-04cd3a60-d01e-42ab-ab43-c323272b3527 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:20.848594 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-04cd3a60-d01e-42ab-ab43-c323272b3527 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:20.849360 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-04cd3a60-d01e-42ab-ab43-c323272b3527 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:20.849795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-04cd3a60-d01e-42ab-ab43-c323272b3527 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:20.977535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-04cd3a60-d01e-42ab-ab43-c323272b3527 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:20.985285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-04cd3a60-d01e-42ab-ab43-c323272b3527 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:20.987459 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-04cd3a60-d01e-42ab-ab43-c323272b3527 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:20.988614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-04cd3a60-d01e-42ab-ab43-c323272b3527 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.151341 Oct 27 14:15:20.989168 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 761/1144] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:20 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:22.006373 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a4335fbf-6f23-46e9-8fb5-6cb162c78408 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:22.007001 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a4335fbf-6f23-46e9-8fb5-6cb162c78408 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:22.013483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4335fbf-6f23-46e9-8fb5-6cb162c78408 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:22.013928 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4335fbf-6f23-46e9-8fb5-6cb162c78408 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:22.014709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4335fbf-6f23-46e9-8fb5-6cb162c78408 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:22.015153 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4335fbf-6f23-46e9-8fb5-6cb162c78408 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:22.140499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a4335fbf-6f23-46e9-8fb5-6cb162c78408 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:22.148579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a4335fbf-6f23-46e9-8fb5-6cb162c78408 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:22.150070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a4335fbf-6f23-46e9-8fb5-6cb162c78408 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:22.151242 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a4335fbf-6f23-46e9-8fb5-6cb162c78408 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.148755 Oct 27 14:15:22.151790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 762/1145] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:22 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:23.169439 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1abfacee-3843-4cfc-ac28-00cff5bd9ffd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:23.170214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1abfacee-3843-4cfc-ac28-00cff5bd9ffd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:23.176610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1abfacee-3843-4cfc-ac28-00cff5bd9ffd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:23.177055 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1abfacee-3843-4cfc-ac28-00cff5bd9ffd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:23.177827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1abfacee-3843-4cfc-ac28-00cff5bd9ffd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:23.178261 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1abfacee-3843-4cfc-ac28-00cff5bd9ffd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:23.304242 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1abfacee-3843-4cfc-ac28-00cff5bd9ffd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:23.311968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1abfacee-3843-4cfc-ac28-00cff5bd9ffd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:23.313506 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1abfacee-3843-4cfc-ac28-00cff5bd9ffd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:23.315228 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1abfacee-3843-4cfc-ac28-00cff5bd9ffd tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.148937 Oct 27 14:15:23.315901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 763/1146] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:23 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:23.588003 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-da7b3904-a853-415d-b0cf-9560f8feb2aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:23.588942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-da7b3904-a853-415d-b0cf-9560f8feb2aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:23.594807 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da7b3904-a853-415d-b0cf-9560f8feb2aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:23.595292 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da7b3904-a853-415d-b0cf-9560f8feb2aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:23.596294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da7b3904-a853-415d-b0cf-9560f8feb2aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:23.596585 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-da7b3904-a853-415d-b0cf-9560f8feb2aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:23.627653 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-da7b3904-a853-415d-b0cf-9560f8feb2aa tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 Oct 27 14:15:23.628217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 764/1147] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:15:23 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:15:23.637502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-16054c9f-9deb-4759-aab2-ff41f132b136 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:23.637983 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-16054c9f-9deb-4759-aab2-ff41f132b136 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:23.644316 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-16054c9f-9deb-4759-aab2-ff41f132b136 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:23.644767 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-16054c9f-9deb-4759-aab2-ff41f132b136 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:23.645534 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-16054c9f-9deb-4759-aab2-ff41f132b136 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:23.646320 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-16054c9f-9deb-4759-aab2-ff41f132b136 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:23.676459 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-16054c9f-9deb-4759-aab2-ff41f132b136 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments/f72f23aa-b308-4f3b-b107-e89cc971d162" status: 200 len: 194 microversion: 2.1 time: 0.042474 Oct 27 14:15:23.677040 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 765/1148] 10.222.0.85 () {58 vars in 1412 bytes} [Wed Oct 27 14:15:23 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments/f72f23aa-b308-4f3b-b107-e89cc971d162 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:15:24.332647 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a0d02f2d-1bcf-49e3-99e2-cb791dacbc7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:24.333388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a0d02f2d-1bcf-49e3-99e2-cb791dacbc7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:24.339579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a0d02f2d-1bcf-49e3-99e2-cb791dacbc7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:24.340029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a0d02f2d-1bcf-49e3-99e2-cb791dacbc7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:24.340797 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a0d02f2d-1bcf-49e3-99e2-cb791dacbc7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:24.341232 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a0d02f2d-1bcf-49e3-99e2-cb791dacbc7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:24.463193 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a0d02f2d-1bcf-49e3-99e2-cb791dacbc7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:24.471692 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a0d02f2d-1bcf-49e3-99e2-cb791dacbc7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:24.473196 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a0d02f2d-1bcf-49e3-99e2-cb791dacbc7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:24.474415 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a0d02f2d-1bcf-49e3-99e2-cb791dacbc7e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.145639 Oct 27 14:15:24.474966 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 766/1149] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:24 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:24.975655 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-53413629-a0c7-4100-b61b-a1a6d8e9c957 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19012f85-dcc3-423e-ad92-4054099e9012"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:24.976707 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-53413629-a0c7-4100-b61b-a1a6d8e9c957 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:24.982777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53413629-a0c7-4100-b61b-a1a6d8e9c957 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:24.983257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53413629-a0c7-4100-b61b-a1a6d8e9c957 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:24.984027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53413629-a0c7-4100-b61b-a1a6d8e9c957 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:24.984462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-53413629-a0c7-4100-b61b-a1a6d8e9c957 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:25.229251 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-53413629-a0c7-4100-b61b-a1a6d8e9c957 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257308 Oct 27 14:15:25.230635 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 767/1150] 10.222.0.85 () {60 vars in 1322 bytes} [Wed Oct 27 14:15:24 2021] POST /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:15:25.492871 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0dfa40bb-85eb-4c0a-b25c-454ac07aba35 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:25.493507 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0dfa40bb-85eb-4c0a-b25c-454ac07aba35 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:25.499468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0dfa40bb-85eb-4c0a-b25c-454ac07aba35 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:25.499908 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0dfa40bb-85eb-4c0a-b25c-454ac07aba35 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:25.500670 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0dfa40bb-85eb-4c0a-b25c-454ac07aba35 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:25.501096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0dfa40bb-85eb-4c0a-b25c-454ac07aba35 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:25.623898 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0dfa40bb-85eb-4c0a-b25c-454ac07aba35 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:25.632575 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0dfa40bb-85eb-4c0a-b25c-454ac07aba35 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:25.633912 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-0dfa40bb-85eb-4c0a-b25c-454ac07aba35 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:25.635080 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0dfa40bb-85eb-4c0a-b25c-454ac07aba35 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.146917 Oct 27 14:15:25.635680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 768/1151] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:25 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:26.660400 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d8001160-b4a9-40db-9144-3da2d99c9ee4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:26.661038 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d8001160-b4a9-40db-9144-3da2d99c9ee4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:26.667369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8001160-b4a9-40db-9144-3da2d99c9ee4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:26.667814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8001160-b4a9-40db-9144-3da2d99c9ee4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:26.668580 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8001160-b4a9-40db-9144-3da2d99c9ee4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:26.669013 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d8001160-b4a9-40db-9144-3da2d99c9ee4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:26.791934 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d8001160-b4a9-40db-9144-3da2d99c9ee4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:26.800005 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d8001160-b4a9-40db-9144-3da2d99c9ee4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:26.801530 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d8001160-b4a9-40db-9144-3da2d99c9ee4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:26.802681 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d8001160-b4a9-40db-9144-3da2d99c9ee4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1744 microversion: 2.20 time: 0.146740 Oct 27 14:15:26.803267 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 769/1152] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:26 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1744 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:27.822085 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d38804ef-a562-446f-b172-a08ca787c25f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:27.822738 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d38804ef-a562-446f-b172-a08ca787c25f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:27.829412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d38804ef-a562-446f-b172-a08ca787c25f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:27.830194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d38804ef-a562-446f-b172-a08ca787c25f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:27.831677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d38804ef-a562-446f-b172-a08ca787c25f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:27.832260 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d38804ef-a562-446f-b172-a08ca787c25f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:27.961608 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d38804ef-a562-446f-b172-a08ca787c25f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:27.969645 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d38804ef-a562-446f-b172-a08ca787c25f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:27.971391 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d38804ef-a562-446f-b172-a08ca787c25f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:27.972838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d38804ef-a562-446f-b172-a08ca787c25f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1739 microversion: 2.20 time: 0.154416 Oct 27 14:15:27.973433 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 770/1153] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:27 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:28.993700 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2a720d35-06da-48e0-b3c7-f2a7bd73e809 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:28.995847 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2a720d35-06da-48e0-b3c7-f2a7bd73e809 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:29.002651 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a720d35-06da-48e0-b3c7-f2a7bd73e809 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:29.003100 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a720d35-06da-48e0-b3c7-f2a7bd73e809 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:29.003916 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a720d35-06da-48e0-b3c7-f2a7bd73e809 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:29.004353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2a720d35-06da-48e0-b3c7-f2a7bd73e809 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:29.145200 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2a720d35-06da-48e0-b3c7-f2a7bd73e809 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:29.155049 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2a720d35-06da-48e0-b3c7-f2a7bd73e809 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:29.156737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2a720d35-06da-48e0-b3c7-f2a7bd73e809 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:29.158114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2a720d35-06da-48e0-b3c7-f2a7bd73e809 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1739 microversion: 2.20 time: 0.170514 Oct 27 14:15:29.158935 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 771/1154] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:28 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:29.549807 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-f5176c58-0bf3-4431-9057-6d5b915b5109 req-7827e3b2-9050-48f1-989d-12074ca28f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e905cb-2edf-4221-933f-a7c59abcd554", "name": "network-vif-plugged", "status": "completed", "tag": "7cb0b496-4ac4-4e36-a183-d35a08ddccae"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:29.552075 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:15:29.552075 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:15:29.561253 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-f5176c58-0bf3-4431-9057-6d5b915b5109 req-7827e3b2-9050-48f1-989d-12074ca28f0b service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:29.562101 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-f5176c58-0bf3-4431-9057-6d5b915b5109 req-7827e3b2-9050-48f1-989d-12074ca28f0b service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:29.578775 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-f5176c58-0bf3-4431-9057-6d5b915b5109 req-7827e3b2-9050-48f1-989d-12074ca28f0b service nova] Creating event network-vif-plugged:7cb0b496-4ac4-4e36-a183-d35a08ddccae for instance e2e905cb-2edf-4221-933f-a7c59abcd554 on hv-cinder-81566 Oct 27 14:15:29.586425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-f5176c58-0bf3-4431-9057-6d5b915b5109 req-7827e3b2-9050-48f1-989d-12074ca28f0b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044557 Oct 27 14:15:29.587763 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 772/1155] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:15:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:15:29.959671 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-0317a0b3-a9db-407b-9650-3c48056707eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:29.960367 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-0317a0b3-a9db-407b-9650-3c48056707eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:29.967201 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0317a0b3-a9db-407b-9650-3c48056707eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:29.967734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0317a0b3-a9db-407b-9650-3c48056707eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:29.968770 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0317a0b3-a9db-407b-9650-3c48056707eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:29.969372 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-0317a0b3-a9db-407b-9650-3c48056707eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:29.998924 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-0317a0b3-a9db-407b-9650-3c48056707eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lazy-loading 'flavor' on Instance uuid 0cb7ac2c-4e45-46c4-8b56-062aac14258b {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:15:30.102496 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-0317a0b3-a9db-407b-9650-3c48056707eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "POST /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b/action" status: 202 len: 0 microversion: 2.1 time: 0.147985 Oct 27 14:15:30.103095 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 773/1156] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:29 2021] POST /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:15:30.115615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-15f1df22-ab09-4e2a-b183-674c4fa02b6e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:30.116827 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-15f1df22-ab09-4e2a-b183-674c4fa02b6e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:30.123944 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-15f1df22-ab09-4e2a-b183-674c4fa02b6e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:30.124395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-15f1df22-ab09-4e2a-b183-674c4fa02b6e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:30.125372 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-15f1df22-ab09-4e2a-b183-674c4fa02b6e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:30.125819 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-15f1df22-ab09-4e2a-b183-674c4fa02b6e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:30.285763 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-15f1df22-ab09-4e2a-b183-674c4fa02b6e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:30.294401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-15f1df22-ab09-4e2a-b183-674c4fa02b6e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.186663 Oct 27 14:15:30.295385 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 774/1157] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:30 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:15:30.300373 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5633966f-d7c9-4e72-b440-f528684b0611 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:30.300983 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5633966f-d7c9-4e72-b440-f528684b0611 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:30.312174 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5633966f-d7c9-4e72-b440-f528684b0611 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:30.312600 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5633966f-d7c9-4e72-b440-f528684b0611 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:30.313212 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5633966f-d7c9-4e72-b440-f528684b0611 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:30.313639 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5633966f-d7c9-4e72-b440-f528684b0611 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:30.458259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5633966f-d7c9-4e72-b440-f528684b0611 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:30.469391 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5633966f-d7c9-4e72-b440-f528684b0611 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:30.470970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5633966f-d7c9-4e72-b440-f528684b0611 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:30.472201 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5633966f-d7c9-4e72-b440-f528684b0611 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1739 microversion: 2.20 time: 0.176119 Oct 27 14:15:30.472930 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 775/1158] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:30 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:31.315783 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-65b60b6f-a777-4c1c-9eed-4c95780568c5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:31.317446 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-65b60b6f-a777-4c1c-9eed-4c95780568c5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:31.324874 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65b60b6f-a777-4c1c-9eed-4c95780568c5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:31.325665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65b60b6f-a777-4c1c-9eed-4c95780568c5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:31.326692 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65b60b6f-a777-4c1c-9eed-4c95780568c5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:31.327401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-65b60b6f-a777-4c1c-9eed-4c95780568c5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:31.465326 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-65b60b6f-a777-4c1c-9eed-4c95780568c5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:31.474166 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-65b60b6f-a777-4c1c-9eed-4c95780568c5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.164112 Oct 27 14:15:31.483804 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 776/1159] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:31 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:31.490937 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5e65134a-3ff6-4500-ab65-3da5fa56daa0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:31.492157 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5e65134a-3ff6-4500-ab65-3da5fa56daa0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:31.498482 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e65134a-3ff6-4500-ab65-3da5fa56daa0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:31.498935 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e65134a-3ff6-4500-ab65-3da5fa56daa0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:31.499740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e65134a-3ff6-4500-ab65-3da5fa56daa0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:31.500176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5e65134a-3ff6-4500-ab65-3da5fa56daa0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:31.668816 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5e65134a-3ff6-4500-ab65-3da5fa56daa0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:31.677793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5e65134a-3ff6-4500-ab65-3da5fa56daa0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:31.679329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5e65134a-3ff6-4500-ab65-3da5fa56daa0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:31.680494 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5e65134a-3ff6-4500-ab65-3da5fa56daa0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1739 microversion: 2.20 time: 0.193701 Oct 27 14:15:31.681215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 777/1160] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:31 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:32.492024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9b3c160c-f255-433c-868f-a2810a7d546d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:32.492664 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9b3c160c-f255-433c-868f-a2810a7d546d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:32.499095 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b3c160c-f255-433c-868f-a2810a7d546d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:32.499572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b3c160c-f255-433c-868f-a2810a7d546d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:32.500440 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b3c160c-f255-433c-868f-a2810a7d546d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:32.501213 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b3c160c-f255-433c-868f-a2810a7d546d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:32.656700 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9b3c160c-f255-433c-868f-a2810a7d546d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:32.666920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9b3c160c-f255-433c-868f-a2810a7d546d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.178614 Oct 27 14:15:32.676413 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 778/1161] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:32 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:32.702546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-61e6bfd1-e50e-44be-84c7-e1d20613098d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:32.703354 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-61e6bfd1-e50e-44be-84c7-e1d20613098d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:32.710428 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-61e6bfd1-e50e-44be-84c7-e1d20613098d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:32.710880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-61e6bfd1-e50e-44be-84c7-e1d20613098d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:32.711697 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-61e6bfd1-e50e-44be-84c7-e1d20613098d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:32.712124 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-61e6bfd1-e50e-44be-84c7-e1d20613098d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:32.857627 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-61e6bfd1-e50e-44be-84c7-e1d20613098d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:32.868026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-61e6bfd1-e50e-44be-84c7-e1d20613098d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:32.869862 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-61e6bfd1-e50e-44be-84c7-e1d20613098d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:32.871031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-61e6bfd1-e50e-44be-84c7-e1d20613098d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1739 microversion: 2.20 time: 0.172441 Oct 27 14:15:32.871902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 779/1162] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:32 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:32.876425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-092fa6dc-2f0f-4818-a0ff-a44045044965 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:32.877435 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-092fa6dc-2f0f-4818-a0ff-a44045044965 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:32.885675 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-092fa6dc-2f0f-4818-a0ff-a44045044965 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:32.886332 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-092fa6dc-2f0f-4818-a0ff-a44045044965 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:32.887009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-092fa6dc-2f0f-4818-a0ff-a44045044965 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:32.887548 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-092fa6dc-2f0f-4818-a0ff-a44045044965 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:32.925141 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-092fa6dc-2f0f-4818-a0ff-a44045044965 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051780 Oct 27 14:15:32.925763 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 780/1163] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:15:32 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:15:33.685159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8158d97b-df87-4bc5-9428-a7e3e49a2312 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:33.685919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8158d97b-df87-4bc5-9428-a7e3e49a2312 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:33.693386 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8158d97b-df87-4bc5-9428-a7e3e49a2312 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:33.693913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8158d97b-df87-4bc5-9428-a7e3e49a2312 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:33.695630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8158d97b-df87-4bc5-9428-a7e3e49a2312 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:33.695630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8158d97b-df87-4bc5-9428-a7e3e49a2312 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:33.849936 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8158d97b-df87-4bc5-9428-a7e3e49a2312 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:33.858658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8158d97b-df87-4bc5-9428-a7e3e49a2312 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.177621 Oct 27 14:15:33.859339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 781/1164] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:33 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:33.892518 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-381e8bde-8fec-4c6d-85fd-a25af03703d0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:33.893350 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-381e8bde-8fec-4c6d-85fd-a25af03703d0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:33.900296 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-381e8bde-8fec-4c6d-85fd-a25af03703d0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:33.900829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-381e8bde-8fec-4c6d-85fd-a25af03703d0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:33.901614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-381e8bde-8fec-4c6d-85fd-a25af03703d0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:33.902063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-381e8bde-8fec-4c6d-85fd-a25af03703d0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:34.055317 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-381e8bde-8fec-4c6d-85fd-a25af03703d0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:34.066069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-381e8bde-8fec-4c6d-85fd-a25af03703d0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:34.067602 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-381e8bde-8fec-4c6d-85fd-a25af03703d0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:34.068788 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-381e8bde-8fec-4c6d-85fd-a25af03703d0 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1739 microversion: 2.20 time: 0.180147 Oct 27 14:15:34.075425 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 782/1165] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:33 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:34.876648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-acdfc015-05d4-4813-bce9-dd2174accc67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:34.877952 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-acdfc015-05d4-4813-bce9-dd2174accc67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:34.885947 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-acdfc015-05d4-4813-bce9-dd2174accc67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:34.886400 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-acdfc015-05d4-4813-bce9-dd2174accc67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:34.887281 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-acdfc015-05d4-4813-bce9-dd2174accc67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:34.887682 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-acdfc015-05d4-4813-bce9-dd2174accc67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:35.037009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-acdfc015-05d4-4813-bce9-dd2174accc67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:35.045021 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-acdfc015-05d4-4813-bce9-dd2174accc67 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.172066 Oct 27 14:15:35.046046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 783/1166] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:34 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:35.087327 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2e7098dc-4328-48c2-b3de-5a38ade72ad7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:35.087936 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2e7098dc-4328-48c2-b3de-5a38ade72ad7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:35.093952 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2e7098dc-4328-48c2-b3de-5a38ade72ad7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:35.094390 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2e7098dc-4328-48c2-b3de-5a38ade72ad7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:35.095170 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2e7098dc-4328-48c2-b3de-5a38ade72ad7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:35.095605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2e7098dc-4328-48c2-b3de-5a38ade72ad7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:35.232220 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2e7098dc-4328-48c2-b3de-5a38ade72ad7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:35.243605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2e7098dc-4328-48c2-b3de-5a38ade72ad7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:35.245235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2e7098dc-4328-48c2-b3de-5a38ade72ad7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:35.246761 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2e7098dc-4328-48c2-b3de-5a38ade72ad7 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1739 microversion: 2.20 time: 0.162864 Oct 27 14:15:35.251209 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 784/1167] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:35 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:36.062324 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ba7157ae-301a-40d4-8ce0-30546fb3334b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:36.062992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ba7157ae-301a-40d4-8ce0-30546fb3334b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:36.070135 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ba7157ae-301a-40d4-8ce0-30546fb3334b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:36.070586 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ba7157ae-301a-40d4-8ce0-30546fb3334b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:36.071402 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ba7157ae-301a-40d4-8ce0-30546fb3334b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:36.071820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ba7157ae-301a-40d4-8ce0-30546fb3334b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:36.204423 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ba7157ae-301a-40d4-8ce0-30546fb3334b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:36.215720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ba7157ae-301a-40d4-8ce0-30546fb3334b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.157125 Oct 27 14:15:36.216580 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 785/1168] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:36 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:36.265007 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5c61ce4a-0436-4de3-809f-8033668f0041 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:36.265779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5c61ce4a-0436-4de3-809f-8033668f0041 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:36.272295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c61ce4a-0436-4de3-809f-8033668f0041 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:36.272875 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c61ce4a-0436-4de3-809f-8033668f0041 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:36.273658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c61ce4a-0436-4de3-809f-8033668f0041 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:36.274095 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c61ce4a-0436-4de3-809f-8033668f0041 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:36.408350 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5c61ce4a-0436-4de3-809f-8033668f0041 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:36.417386 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5c61ce4a-0436-4de3-809f-8033668f0041 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:36.418876 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5c61ce4a-0436-4de3-809f-8033668f0041 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:36.420059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5c61ce4a-0436-4de3-809f-8033668f0041 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1739 microversion: 2.20 time: 0.158842 Oct 27 14:15:36.420842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 786/1169] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:36 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:37.233867 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-89b7bacf-30d2-4494-83b6-b0a3f1d5d6a2 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:37.234625 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-89b7bacf-30d2-4494-83b6-b0a3f1d5d6a2 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:37.241539 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-89b7bacf-30d2-4494-83b6-b0a3f1d5d6a2 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:37.241987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-89b7bacf-30d2-4494-83b6-b0a3f1d5d6a2 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:37.242850 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-89b7bacf-30d2-4494-83b6-b0a3f1d5d6a2 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:37.243231 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-89b7bacf-30d2-4494-83b6-b0a3f1d5d6a2 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:37.367274 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-89b7bacf-30d2-4494-83b6-b0a3f1d5d6a2 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:37.374570 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-89b7bacf-30d2-4494-83b6-b0a3f1d5d6a2 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.144547 Oct 27 14:15:37.375143 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 787/1170] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:37 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:37.438529 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7fd93f83-5ad0-4608-a82d-a139e5a8320e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:37.439178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7fd93f83-5ad0-4608-a82d-a139e5a8320e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:37.445987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fd93f83-5ad0-4608-a82d-a139e5a8320e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:37.446440 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fd93f83-5ad0-4608-a82d-a139e5a8320e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:37.447233 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fd93f83-5ad0-4608-a82d-a139e5a8320e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:37.447667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7fd93f83-5ad0-4608-a82d-a139e5a8320e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:37.573469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7fd93f83-5ad0-4608-a82d-a139e5a8320e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:37.582196 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7fd93f83-5ad0-4608-a82d-a139e5a8320e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:37.583708 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7fd93f83-5ad0-4608-a82d-a139e5a8320e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:37.584851 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7fd93f83-5ad0-4608-a82d-a139e5a8320e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1739 microversion: 2.20 time: 0.150072 Oct 27 14:15:37.585404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 788/1171] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:37 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:38.391537 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-eba1dd3a-2715-41fb-a906-c0b8bc49540a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:38.392184 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-eba1dd3a-2715-41fb-a906-c0b8bc49540a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:38.399293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eba1dd3a-2715-41fb-a906-c0b8bc49540a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:38.399745 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eba1dd3a-2715-41fb-a906-c0b8bc49540a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:38.400493 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eba1dd3a-2715-41fb-a906-c0b8bc49540a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:38.400970 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-eba1dd3a-2715-41fb-a906-c0b8bc49540a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:38.529776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-eba1dd3a-2715-41fb-a906-c0b8bc49540a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:38.537752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-eba1dd3a-2715-41fb-a906-c0b8bc49540a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.149845 Oct 27 14:15:38.538313 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 789/1172] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:38 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:38.602665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-003b5586-a4f2-4660-90e2-f115f6e74f26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:38.603318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-003b5586-a4f2-4660-90e2-f115f6e74f26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:38.609124 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-003b5586-a4f2-4660-90e2-f115f6e74f26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:38.609569 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-003b5586-a4f2-4660-90e2-f115f6e74f26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:38.610329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-003b5586-a4f2-4660-90e2-f115f6e74f26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:38.610765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-003b5586-a4f2-4660-90e2-f115f6e74f26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:38.738173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-003b5586-a4f2-4660-90e2-f115f6e74f26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:38.745868 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-003b5586-a4f2-4660-90e2-f115f6e74f26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:38.747380 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-003b5586-a4f2-4660-90e2-f115f6e74f26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:38.748520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-003b5586-a4f2-4660-90e2-f115f6e74f26 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1721 microversion: 2.20 time: 0.149497 Oct 27 14:15:38.749070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 790/1173] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:38 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:39.555276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-55e36bbc-eccf-4fd0-a590-65a04c037093 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:39.556030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-55e36bbc-eccf-4fd0-a590-65a04c037093 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:39.562143 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-55e36bbc-eccf-4fd0-a590-65a04c037093 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:39.562617 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-55e36bbc-eccf-4fd0-a590-65a04c037093 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:39.563416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-55e36bbc-eccf-4fd0-a590-65a04c037093 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:39.563847 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-55e36bbc-eccf-4fd0-a590-65a04c037093 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:39.687999 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-55e36bbc-eccf-4fd0-a590-65a04c037093 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:39.696054 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-55e36bbc-eccf-4fd0-a590-65a04c037093 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.144524 Oct 27 14:15:39.696617 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 791/1174] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:39 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:39.765853 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7534b4e3-f0d1-4d76-b4c2-31a7687e2bcf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:39.766448 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7534b4e3-f0d1-4d76-b4c2-31a7687e2bcf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:39.772573 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7534b4e3-f0d1-4d76-b4c2-31a7687e2bcf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:39.773014 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7534b4e3-f0d1-4d76-b4c2-31a7687e2bcf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:39.773769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7534b4e3-f0d1-4d76-b4c2-31a7687e2bcf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:39.774199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7534b4e3-f0d1-4d76-b4c2-31a7687e2bcf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:39.896065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7534b4e3-f0d1-4d76-b4c2-31a7687e2bcf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:39.903989 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7534b4e3-f0d1-4d76-b4c2-31a7687e2bcf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:39.905489 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7534b4e3-f0d1-4d76-b4c2-31a7687e2bcf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:39.906634 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7534b4e3-f0d1-4d76-b4c2-31a7687e2bcf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1721 microversion: 2.20 time: 0.144347 Oct 27 14:15:39.907212 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 792/1175] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:39 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:40.712821 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-51d96c27-2c3b-4133-b67b-f7ba6b450c18 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:40.713541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-51d96c27-2c3b-4133-b67b-f7ba6b450c18 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:40.719754 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-51d96c27-2c3b-4133-b67b-f7ba6b450c18 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:40.720254 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-51d96c27-2c3b-4133-b67b-f7ba6b450c18 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:40.721539 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-51d96c27-2c3b-4133-b67b-f7ba6b450c18 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:40.722009 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-51d96c27-2c3b-4133-b67b-f7ba6b450c18 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:40.915905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-51d96c27-2c3b-4133-b67b-f7ba6b450c18 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:40.923287 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-51d96c27-2c3b-4133-b67b-f7ba6b450c18 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.214171 Oct 27 14:15:40.923855 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 793/1176] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:40 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:40.928528 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-56164cf6-3da0-4217-b8cc-5ac7d1fa35b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:40.929114 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-56164cf6-3da0-4217-b8cc-5ac7d1fa35b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:40.934604 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-56164cf6-3da0-4217-b8cc-5ac7d1fa35b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:40.935038 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-56164cf6-3da0-4217-b8cc-5ac7d1fa35b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:40.935854 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-56164cf6-3da0-4217-b8cc-5ac7d1fa35b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:40.936278 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-56164cf6-3da0-4217-b8cc-5ac7d1fa35b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:41.061887 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-56164cf6-3da0-4217-b8cc-5ac7d1fa35b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:41.069773 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-56164cf6-3da0-4217-b8cc-5ac7d1fa35b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:41.071310 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-56164cf6-3da0-4217-b8cc-5ac7d1fa35b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:41.072464 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-56164cf6-3da0-4217-b8cc-5ac7d1fa35b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1664 microversion: 2.20 time: 0.147705 Oct 27 14:15:41.073018 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 794/1177] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:40 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:41.090718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4cd1192a-d5c1-4f37-aac9-5030c845498e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4109b40d-f7f6-440b-bb5d-62c52110e254"}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:41.091798 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4cd1192a-d5c1-4f37-aac9-5030c845498e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:41.098578 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4cd1192a-d5c1-4f37-aac9-5030c845498e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:41.099029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4cd1192a-d5c1-4f37-aac9-5030c845498e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:41.099825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4cd1192a-d5c1-4f37-aac9-5030c845498e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:41.100259 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4cd1192a-d5c1-4f37-aac9-5030c845498e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:41.355906 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4cd1192a-d5c1-4f37-aac9-5030c845498e tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.268937 Oct 27 14:15:41.356498 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 795/1178] 10.222.0.85 () {62 vars in 1363 bytes} [Wed Oct 27 14:15:41 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/os-volume_attachments => generated 188 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 14:15:41.465854 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-040db8a9-a4cd-4e6d-849a-a5eea92c863b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:41.466342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-040db8a9-a4cd-4e6d-849a-a5eea92c863b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:41.472813 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-040db8a9-a4cd-4e6d-849a-a5eea92c863b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:41.473256 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-040db8a9-a4cd-4e6d-849a-a5eea92c863b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:41.474023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-040db8a9-a4cd-4e6d-849a-a5eea92c863b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:41.474458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-040db8a9-a4cd-4e6d-849a-a5eea92c863b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:41.732411 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-040db8a9-a4cd-4e6d-849a-a5eea92c863b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/os-volume_attachments/4109b40d-f7f6-440b-bb5d-62c52110e254" status: 202 len: 0 microversion: 2.20 time: 0.271015 Oct 27 14:15:41.733147 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 796/1179] 10.222.0.85 () {60 vars in 1456 bytes} [Wed Oct 27 14:15:41 2021] DELETE /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/os-volume_attachments/4109b40d-f7f6-440b-bb5d-62c52110e254 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:15:41.738693 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-1da21369-d287-4a9f-ab60-bbedd406f91e req-1a3a9594-5f6c-448a-8066-559545df41f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e905cb-2edf-4221-933f-a7c59abcd554", "name": "network-vif-unplugged", "status": "completed", "tag": "7cb0b496-4ac4-4e36-a183-d35a08ddccae"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:41.740294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:15:41.740294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:15:41.747167 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-1da21369-d287-4a9f-ab60-bbedd406f91e req-1a3a9594-5f6c-448a-8066-559545df41f7 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:41.747597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-1da21369-d287-4a9f-ab60-bbedd406f91e req-1a3a9594-5f6c-448a-8066-559545df41f7 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:41.758513 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.compute.server_external_events [req-1da21369-d287-4a9f-ab60-bbedd406f91e req-1a3a9594-5f6c-448a-8066-559545df41f7 service nova] Unable to find a host for instance e2e905cb-2edf-4221-933f-a7c59abcd554. Dropping event network-vif-unplugged {{(pid=115931) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 27 14:15:41.759401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-1da21369-d287-4a9f-ab60-bbedd406f91e req-1a3a9594-5f6c-448a-8066-559545df41f7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025491 Oct 27 14:15:41.760012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 797/1180] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:15:41 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 14:15:41.788557 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a999248e-24d6-4bd3-8d6a-3571a512c31b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:41.789120 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a999248e-24d6-4bd3-8d6a-3571a512c31b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:41.794962 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a999248e-24d6-4bd3-8d6a-3571a512c31b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:41.795443 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a999248e-24d6-4bd3-8d6a-3571a512c31b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:41.796203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a999248e-24d6-4bd3-8d6a-3571a512c31b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:41.796633 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a999248e-24d6-4bd3-8d6a-3571a512c31b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:41.870286 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a999248e-24d6-4bd3-8d6a-3571a512c31b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action" status: 202 len: 0 microversion: 2.20 time: 0.086347 Oct 27 14:15:41.870998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 798/1181] 10.222.0.85 () {62 vars in 1318 bytes} [Wed Oct 27 14:15:41 2021] POST /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:15:41.878746 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-60c8c9c2-7fdc-4e00-8410-65f9cf196ddf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:41.879379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-60c8c9c2-7fdc-4e00-8410-65f9cf196ddf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:41.885281 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-60c8c9c2-7fdc-4e00-8410-65f9cf196ddf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:41.885816 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-60c8c9c2-7fdc-4e00-8410-65f9cf196ddf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:41.886495 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-60c8c9c2-7fdc-4e00-8410-65f9cf196ddf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:41.886931 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-60c8c9c2-7fdc-4e00-8410-65f9cf196ddf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:42.014118 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-60c8c9c2-7fdc-4e00-8410-65f9cf196ddf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:42.022797 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-60c8c9c2-7fdc-4e00-8410-65f9cf196ddf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:42.024320 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-60c8c9c2-7fdc-4e00-8410-65f9cf196ddf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:42.025479 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-60c8c9c2-7fdc-4e00-8410-65f9cf196ddf tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1672 microversion: 2.20 time: 0.150450 Oct 27 14:15:42.026059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 799/1182] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:41 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:42.031326 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-57a3734e-e188-4e59-86b4-1a33215a2678 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:42.031326 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-57a3734e-e188-4e59-86b4-1a33215a2678 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:42.037136 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57a3734e-e188-4e59-86b4-1a33215a2678 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:42.037581 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57a3734e-e188-4e59-86b4-1a33215a2678 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:42.038350 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57a3734e-e188-4e59-86b4-1a33215a2678 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:42.038779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-57a3734e-e188-4e59-86b4-1a33215a2678 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:42.169841 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-57a3734e-e188-4e59-86b4-1a33215a2678 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:42.178376 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-57a3734e-e188-4e59-86b4-1a33215a2678 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.151287 Oct 27 14:15:42.179014 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 800/1183] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:42 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:15:43.044574 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1b9dc870-9eaa-4c63-9b79-db0d29fc014f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:43.045174 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1b9dc870-9eaa-4c63-9b79-db0d29fc014f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:43.052334 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b9dc870-9eaa-4c63-9b79-db0d29fc014f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:43.052787 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b9dc870-9eaa-4c63-9b79-db0d29fc014f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:43.053568 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b9dc870-9eaa-4c63-9b79-db0d29fc014f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:43.054015 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b9dc870-9eaa-4c63-9b79-db0d29fc014f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:43.183616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1b9dc870-9eaa-4c63-9b79-db0d29fc014f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:43.192171 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1b9dc870-9eaa-4c63-9b79-db0d29fc014f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:43.193777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1b9dc870-9eaa-4c63-9b79-db0d29fc014f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:43.195104 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1b9dc870-9eaa-4c63-9b79-db0d29fc014f tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.154262 Oct 27 14:15:43.195687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 801/1184] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:43 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:43.201255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3c72dc9c-9d6d-4c0c-8491-a2243d723f86 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:43.202096 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3c72dc9c-9d6d-4c0c-8491-a2243d723f86 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:43.209502 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3c72dc9c-9d6d-4c0c-8491-a2243d723f86 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:43.210001 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3c72dc9c-9d6d-4c0c-8491-a2243d723f86 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:43.210749 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3c72dc9c-9d6d-4c0c-8491-a2243d723f86 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:43.211373 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3c72dc9c-9d6d-4c0c-8491-a2243d723f86 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:43.681998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3c72dc9c-9d6d-4c0c-8491-a2243d723f86 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:43.689470 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3c72dc9c-9d6d-4c0c-8491-a2243d723f86 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1570 microversion: 2.1 time: 0.492617 Oct 27 14:15:43.690452 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 802/1185] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:43 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1570 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:15:43.705584 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-651c8d71-ec60-4e57-8860-71b14900cf6a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:43.706131 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-651c8d71-ec60-4e57-8860-71b14900cf6a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:43.711791 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-651c8d71-ec60-4e57-8860-71b14900cf6a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:43.712233 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-651c8d71-ec60-4e57-8860-71b14900cf6a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:43.712998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-651c8d71-ec60-4e57-8860-71b14900cf6a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:43.713422 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-651c8d71-ec60-4e57-8860-71b14900cf6a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:43.789341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-651c8d71-ec60-4e57-8860-71b14900cf6a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "POST /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b/action" status: 202 len: 0 microversion: 2.1 time: 0.087198 Oct 27 14:15:43.790035 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 803/1186] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Oct 27 14:15:43 2021] POST /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:15:43.798029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c061e973-f6be-4ec1-ac8f-95396063431b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:43.798638 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c061e973-f6be-4ec1-ac8f-95396063431b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:43.805305 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c061e973-f6be-4ec1-ac8f-95396063431b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:43.805759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c061e973-f6be-4ec1-ac8f-95396063431b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:43.806677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c061e973-f6be-4ec1-ac8f-95396063431b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:43.806968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c061e973-f6be-4ec1-ac8f-95396063431b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:43.981246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c061e973-f6be-4ec1-ac8f-95396063431b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:43.990799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c061e973-f6be-4ec1-ac8f-95396063431b tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1518 microversion: 2.1 time: 0.196644 Oct 27 14:15:43.991761 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 804/1187] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:43 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:44.213790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5d02ad96-046f-48f8-a6f0-d0c635ad88bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:44.214272 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5d02ad96-046f-48f8-a6f0-d0c635ad88bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:44.220679 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5d02ad96-046f-48f8-a6f0-d0c635ad88bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:44.221140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5d02ad96-046f-48f8-a6f0-d0c635ad88bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:44.222029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5d02ad96-046f-48f8-a6f0-d0c635ad88bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:44.222570 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5d02ad96-046f-48f8-a6f0-d0c635ad88bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:44.358110 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5d02ad96-046f-48f8-a6f0-d0c635ad88bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:44.366076 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5d02ad96-046f-48f8-a6f0-d0c635ad88bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:44.367576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5d02ad96-046f-48f8-a6f0-d0c635ad88bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:44.368746 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5d02ad96-046f-48f8-a6f0-d0c635ad88bb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.158804 Oct 27 14:15:44.369304 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 805/1188] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:44 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:45.009978 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1c911cc5-0664-4e0f-9c6b-5fd9b73a0e4e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:45.010458 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1c911cc5-0664-4e0f-9c6b-5fd9b73a0e4e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:45.016808 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c911cc5-0664-4e0f-9c6b-5fd9b73a0e4e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:45.017491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c911cc5-0664-4e0f-9c6b-5fd9b73a0e4e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:45.019056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c911cc5-0664-4e0f-9c6b-5fd9b73a0e4e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:45.019690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1c911cc5-0664-4e0f-9c6b-5fd9b73a0e4e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:45.164335 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1c911cc5-0664-4e0f-9c6b-5fd9b73a0e4e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:45.171823 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1c911cc5-0664-4e0f-9c6b-5fd9b73a0e4e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1520 microversion: 2.1 time: 0.165732 Oct 27 14:15:45.172392 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 806/1189] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:45 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:45.387545 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-356b540f-f5ee-4dbb-abea-0a8d42b4008b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:45.388203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-356b540f-f5ee-4dbb-abea-0a8d42b4008b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:45.395385 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-356b540f-f5ee-4dbb-abea-0a8d42b4008b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:45.395883 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-356b540f-f5ee-4dbb-abea-0a8d42b4008b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:45.396677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-356b540f-f5ee-4dbb-abea-0a8d42b4008b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:45.397369 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-356b540f-f5ee-4dbb-abea-0a8d42b4008b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:45.537402 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-356b540f-f5ee-4dbb-abea-0a8d42b4008b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:45.545150 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-356b540f-f5ee-4dbb-abea-0a8d42b4008b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:45.546652 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-356b540f-f5ee-4dbb-abea-0a8d42b4008b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:45.547845 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-356b540f-f5ee-4dbb-abea-0a8d42b4008b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.164028 Oct 27 14:15:45.548470 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 807/1190] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:45 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:46.189674 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-41018531-df37-4268-98ed-a4f3da34d69e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:46.190592 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-41018531-df37-4268-98ed-a4f3da34d69e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:46.197581 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41018531-df37-4268-98ed-a4f3da34d69e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:46.198021 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41018531-df37-4268-98ed-a4f3da34d69e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:46.198799 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41018531-df37-4268-98ed-a4f3da34d69e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:46.199265 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-41018531-df37-4268-98ed-a4f3da34d69e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:46.336262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-41018531-df37-4268-98ed-a4f3da34d69e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:46.344031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-41018531-df37-4268-98ed-a4f3da34d69e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1520 microversion: 2.1 time: 0.158047 Oct 27 14:15:46.344587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 808/1191] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:46 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:46.567659 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bbb1641e-d1a8-4e9a-a081-05e6e18aba02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:46.568324 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-bbb1641e-d1a8-4e9a-a081-05e6e18aba02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:46.574403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bbb1641e-d1a8-4e9a-a081-05e6e18aba02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:46.574849 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bbb1641e-d1a8-4e9a-a081-05e6e18aba02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:46.575673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bbb1641e-d1a8-4e9a-a081-05e6e18aba02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:46.576107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bbb1641e-d1a8-4e9a-a081-05e6e18aba02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:46.706789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bbb1641e-d1a8-4e9a-a081-05e6e18aba02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:46.717614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bbb1641e-d1a8-4e9a-a081-05e6e18aba02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:46.719440 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bbb1641e-d1a8-4e9a-a081-05e6e18aba02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:46.720791 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bbb1641e-d1a8-4e9a-a081-05e6e18aba02 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.157546 Oct 27 14:15:46.722031 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 809/1192] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:46 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:47.361571 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bd8dbd38-9a96-4d61-8b94-5f590efa5b21 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:47.362942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-bd8dbd38-9a96-4d61-8b94-5f590efa5b21 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:47.370763 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd8dbd38-9a96-4d61-8b94-5f590efa5b21 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:47.371317 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd8dbd38-9a96-4d61-8b94-5f590efa5b21 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:47.372247 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd8dbd38-9a96-4d61-8b94-5f590efa5b21 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:47.372738 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bd8dbd38-9a96-4d61-8b94-5f590efa5b21 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:47.501811 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bd8dbd38-9a96-4d61-8b94-5f590efa5b21 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:47.509881 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bd8dbd38-9a96-4d61-8b94-5f590efa5b21 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1520 microversion: 2.1 time: 0.151752 Oct 27 14:15:47.511193 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 810/1193] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:47 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:47.586610 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-a6fa32a0-92e9-4ec3-9148-b8e169ffb2f1 req-8b197caa-964c-4a2a-8896-bea61015bb20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb7ac2c-4e45-46c4-8b56-062aac14258b", "name": "network-vif-unplugged", "status": "completed", "tag": "e5f6c633-3fb1-4c33-8bba-2b47432ace5a"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:47.590103 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:15:47.590103 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:15:47.599466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-a6fa32a0-92e9-4ec3-9148-b8e169ffb2f1 req-8b197caa-964c-4a2a-8896-bea61015bb20 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:47.600288 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-a6fa32a0-92e9-4ec3-9148-b8e169ffb2f1 req-8b197caa-964c-4a2a-8896-bea61015bb20 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:47.613831 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.compute.server_external_events [req-a6fa32a0-92e9-4ec3-9148-b8e169ffb2f1 req-8b197caa-964c-4a2a-8896-bea61015bb20 service nova] Unable to find a host for instance 0cb7ac2c-4e45-46c4-8b56-062aac14258b. Dropping event network-vif-unplugged {{(pid=115931) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 27 14:15:47.615392 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-a6fa32a0-92e9-4ec3-9148-b8e169ffb2f1 req-8b197caa-964c-4a2a-8896-bea61015bb20 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032770 Oct 27 14:15:47.616175 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 811/1194] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:15:47 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 27 14:15:47.739342 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8f50f07e-234a-40db-b635-7a5ebdc27f25 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:47.739938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8f50f07e-234a-40db-b635-7a5ebdc27f25 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:47.745838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f50f07e-234a-40db-b635-7a5ebdc27f25 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:47.746276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f50f07e-234a-40db-b635-7a5ebdc27f25 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:47.747027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f50f07e-234a-40db-b635-7a5ebdc27f25 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:47.747483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f50f07e-234a-40db-b635-7a5ebdc27f25 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:47.880352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8f50f07e-234a-40db-b635-7a5ebdc27f25 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:47.888648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8f50f07e-234a-40db-b635-7a5ebdc27f25 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:47.890170 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8f50f07e-234a-40db-b635-7a5ebdc27f25 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:47.891337 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8f50f07e-234a-40db-b635-7a5ebdc27f25 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.155653 Oct 27 14:15:47.891890 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 812/1195] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:47 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:48.469718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c338d4ef-10be-4401-b9c5-ff9e4733bc8d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:48.470471 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c338d4ef-10be-4401-b9c5-ff9e4733bc8d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:48.477508 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c338d4ef-10be-4401-b9c5-ff9e4733bc8d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:48.477994 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c338d4ef-10be-4401-b9c5-ff9e4733bc8d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:48.478779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c338d4ef-10be-4401-b9c5-ff9e4733bc8d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:48.479234 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c338d4ef-10be-4401-b9c5-ff9e4733bc8d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:48.512838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c338d4ef-10be-4401-b9c5-ff9e4733bc8d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments/f72f23aa-b308-4f3b-b107-e89cc971d162" status: 200 len: 194 microversion: 2.1 time: 0.047660 Oct 27 14:15:48.513688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 813/1196] 10.222.0.85 () {58 vars in 1412 bytes} [Wed Oct 27 14:15:48 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments/f72f23aa-b308-4f3b-b107-e89cc971d162 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:15:48.524377 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-827a30f2-ab10-496e-85b1-857604a81243 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:48.524857 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-827a30f2-ab10-496e-85b1-857604a81243 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:48.531279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-827a30f2-ab10-496e-85b1-857604a81243 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:48.531719 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-827a30f2-ab10-496e-85b1-857604a81243 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:48.532477 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-827a30f2-ab10-496e-85b1-857604a81243 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:48.532904 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-827a30f2-ab10-496e-85b1-857604a81243 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:48.629312 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-827a30f2-ab10-496e-85b1-857604a81243 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lazy-loading 'services' on Instance uuid 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:15:48.709421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-827a30f2-ab10-496e-85b1-857604a81243 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "DELETE /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments/f72f23aa-b308-4f3b-b107-e89cc971d162" status: 202 len: 0 microversion: 2.1 time: 0.188835 Oct 27 14:15:48.710166 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 814/1197] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:15:48 2021] DELETE /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments/f72f23aa-b308-4f3b-b107-e89cc971d162 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:15:48.715543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-75e75632-9b29-4f44-944a-8b4b34ef23d7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:48.716463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-75e75632-9b29-4f44-944a-8b4b34ef23d7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:48.724717 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-75e75632-9b29-4f44-944a-8b4b34ef23d7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:48.725299 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-75e75632-9b29-4f44-944a-8b4b34ef23d7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:48.726375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-75e75632-9b29-4f44-944a-8b4b34ef23d7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:48.727531 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-75e75632-9b29-4f44-944a-8b4b34ef23d7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:48.865936 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-75e75632-9b29-4f44-944a-8b4b34ef23d7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:48.873814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-75e75632-9b29-4f44-944a-8b4b34ef23d7 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1520 microversion: 2.1 time: 0.162422 Oct 27 14:15:48.874561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 815/1198] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:48 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:15:48.910219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c311da53-9264-4974-8ac6-7c5c5fd00eec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:48.910982 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c311da53-9264-4974-8ac6-7c5c5fd00eec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:48.917676 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c311da53-9264-4974-8ac6-7c5c5fd00eec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:48.918252 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c311da53-9264-4974-8ac6-7c5c5fd00eec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:48.919067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c311da53-9264-4974-8ac6-7c5c5fd00eec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:48.919533 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c311da53-9264-4974-8ac6-7c5c5fd00eec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:49.067572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c311da53-9264-4974-8ac6-7c5c5fd00eec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:49.076243 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c311da53-9264-4974-8ac6-7c5c5fd00eec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:49.077761 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c311da53-9264-4974-8ac6-7c5c5fd00eec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:49.078945 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c311da53-9264-4974-8ac6-7c5c5fd00eec tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.172918 Oct 27 14:15:49.079727 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 816/1199] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:48 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:49.891329 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8eb4706e-3cb8-482b-aab6-3136cf9fffe0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:49.891977 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8eb4706e-3cb8-482b-aab6-3136cf9fffe0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:49.899335 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8eb4706e-3cb8-482b-aab6-3136cf9fffe0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:49.899796 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8eb4706e-3cb8-482b-aab6-3136cf9fffe0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:49.900620 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8eb4706e-3cb8-482b-aab6-3136cf9fffe0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:49.900992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8eb4706e-3cb8-482b-aab6-3136cf9fffe0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:50.037465 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-8eb4706e-3cb8-482b-aab6-3136cf9fffe0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:50.045448 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8eb4706e-3cb8-482b-aab6-3136cf9fffe0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1520 microversion: 2.1 time: 0.157810 Oct 27 14:15:50.046020 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 817/1200] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:49 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:50.101601 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d64731bb-97f8-4481-b6d3-9fc182cd73b6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:50.102433 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d64731bb-97f8-4481-b6d3-9fc182cd73b6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:50.108787 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d64731bb-97f8-4481-b6d3-9fc182cd73b6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:50.109246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d64731bb-97f8-4481-b6d3-9fc182cd73b6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:50.110023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d64731bb-97f8-4481-b6d3-9fc182cd73b6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:50.110455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d64731bb-97f8-4481-b6d3-9fc182cd73b6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:50.239979 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d64731bb-97f8-4481-b6d3-9fc182cd73b6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:50.248109 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d64731bb-97f8-4481-b6d3-9fc182cd73b6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:50.249644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d64731bb-97f8-4481-b6d3-9fc182cd73b6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:50.250833 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d64731bb-97f8-4481-b6d3-9fc182cd73b6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.155069 Oct 27 14:15:50.251433 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 818/1201] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:50 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:51.064008 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1a491b76-b2b8-4f65-90f5-e49133b9ded0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:51.064889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1a491b76-b2b8-4f65-90f5-e49133b9ded0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:51.072621 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1a491b76-b2b8-4f65-90f5-e49133b9ded0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:51.073232 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1a491b76-b2b8-4f65-90f5-e49133b9ded0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:51.074067 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1a491b76-b2b8-4f65-90f5-e49133b9ded0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:51.074499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1a491b76-b2b8-4f65-90f5-e49133b9ded0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:51.202389 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-1a491b76-b2b8-4f65-90f5-e49133b9ded0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:51.210645 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1a491b76-b2b8-4f65-90f5-e49133b9ded0 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1520 microversion: 2.1 time: 0.152280 Oct 27 14:15:51.211503 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 819/1202] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:51 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:51.273937 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9dabdfe8-9122-4970-86f5-ef6276d3f0cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:51.274543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9dabdfe8-9122-4970-86f5-ef6276d3f0cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:51.280608 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dabdfe8-9122-4970-86f5-ef6276d3f0cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:51.281055 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dabdfe8-9122-4970-86f5-ef6276d3f0cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:51.281821 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dabdfe8-9122-4970-86f5-ef6276d3f0cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:51.282262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dabdfe8-9122-4970-86f5-ef6276d3f0cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:51.415522 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9dabdfe8-9122-4970-86f5-ef6276d3f0cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:51.424290 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9dabdfe8-9122-4970-86f5-ef6276d3f0cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:51.425857 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9dabdfe8-9122-4970-86f5-ef6276d3f0cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:51.427023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9dabdfe8-9122-4970-86f5-ef6276d3f0cb tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.157164 Oct 27 14:15:51.427623 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 820/1203] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:51 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:52.228378 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a4db42ed-7d64-477d-83e7-3632fcc0dc97 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:52.229078 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a4db42ed-7d64-477d-83e7-3632fcc0dc97 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:52.235202 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4db42ed-7d64-477d-83e7-3632fcc0dc97 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:52.235650 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4db42ed-7d64-477d-83e7-3632fcc0dc97 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:52.236414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4db42ed-7d64-477d-83e7-3632fcc0dc97 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:52.236846 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4db42ed-7d64-477d-83e7-3632fcc0dc97 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:52.365499 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a4db42ed-7d64-477d-83e7-3632fcc0dc97 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:52.374203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a4db42ed-7d64-477d-83e7-3632fcc0dc97 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1520 microversion: 2.1 time: 0.149514 Oct 27 14:15:52.383880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 821/1204] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:52 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:52.446010 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5717ec81-009f-490f-aaef-5eac7ecc17f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:52.446656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5717ec81-009f-490f-aaef-5eac7ecc17f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:52.455178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5717ec81-009f-490f-aaef-5eac7ecc17f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:52.455178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5717ec81-009f-490f-aaef-5eac7ecc17f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:52.455178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5717ec81-009f-490f-aaef-5eac7ecc17f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:52.455178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5717ec81-009f-490f-aaef-5eac7ecc17f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:52.585383 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5717ec81-009f-490f-aaef-5eac7ecc17f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:52.595456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5717ec81-009f-490f-aaef-5eac7ecc17f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:52.597419 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5717ec81-009f-490f-aaef-5eac7ecc17f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:52.598615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5717ec81-009f-490f-aaef-5eac7ecc17f4 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.156558 Oct 27 14:15:52.599525 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 822/1205] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:52 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:53.393246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-772ebc8b-e9ea-49cb-877a-50f2f863ec49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:53.394649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-772ebc8b-e9ea-49cb-877a-50f2f863ec49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:53.401210 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-772ebc8b-e9ea-49cb-877a-50f2f863ec49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:53.401644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-772ebc8b-e9ea-49cb-877a-50f2f863ec49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:53.402414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-772ebc8b-e9ea-49cb-877a-50f2f863ec49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:53.402998 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-772ebc8b-e9ea-49cb-877a-50f2f863ec49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:53.559193 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-772ebc8b-e9ea-49cb-877a-50f2f863ec49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:53.567826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-772ebc8b-e9ea-49cb-877a-50f2f863ec49 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1520 microversion: 2.1 time: 0.178258 Oct 27 14:15:53.568404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 823/1206] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:53 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:15:53.618808 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9422901b-52c5-4171-842a-440470b74333 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:53.619767 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9422901b-52c5-4171-842a-440470b74333 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:53.630957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9422901b-52c5-4171-842a-440470b74333 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:53.630957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9422901b-52c5-4171-842a-440470b74333 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:53.630957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9422901b-52c5-4171-842a-440470b74333 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:53.630957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9422901b-52c5-4171-842a-440470b74333 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:53.759090 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9422901b-52c5-4171-842a-440470b74333 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:53.766803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9422901b-52c5-4171-842a-440470b74333 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:53.768826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9422901b-52c5-4171-842a-440470b74333 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:53.769985 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9422901b-52c5-4171-842a-440470b74333 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.155320 Oct 27 14:15:53.770547 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 824/1207] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:53 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:54.586575 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fe08c508-0420-471a-a867-0a3ea3e09fcd tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:54.588448 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fe08c508-0420-471a-a867-0a3ea3e09fcd tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:54.595162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe08c508-0420-471a-a867-0a3ea3e09fcd tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:54.595630 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe08c508-0420-471a-a867-0a3ea3e09fcd tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:54.596401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe08c508-0420-471a-a867-0a3ea3e09fcd tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:54.596829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fe08c508-0420-471a-a867-0a3ea3e09fcd tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:54.721217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fe08c508-0420-471a-a867-0a3ea3e09fcd tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:54.729730 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fe08c508-0420-471a-a867-0a3ea3e09fcd tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1520 microversion: 2.1 time: 0.147827 Oct 27 14:15:54.730517 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 825/1208] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:54 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:54.789026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-509d02ee-6d61-4ea6-91dc-05d0ba1a8191 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:54.789619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-509d02ee-6d61-4ea6-91dc-05d0ba1a8191 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:54.795661 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-509d02ee-6d61-4ea6-91dc-05d0ba1a8191 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:54.796101 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-509d02ee-6d61-4ea6-91dc-05d0ba1a8191 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:54.796857 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-509d02ee-6d61-4ea6-91dc-05d0ba1a8191 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:54.797284 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-509d02ee-6d61-4ea6-91dc-05d0ba1a8191 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:54.928323 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-509d02ee-6d61-4ea6-91dc-05d0ba1a8191 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:54.936368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-509d02ee-6d61-4ea6-91dc-05d0ba1a8191 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:54.937876 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-509d02ee-6d61-4ea6-91dc-05d0ba1a8191 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:54.939034 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-509d02ee-6d61-4ea6-91dc-05d0ba1a8191 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.153780 Oct 27 14:15:54.939632 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 826/1209] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:54 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:55.748194 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d1c6f7a4-8b0d-4240-90ad-42801ac261eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:55.748823 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d1c6f7a4-8b0d-4240-90ad-42801ac261eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:55.755789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d1c6f7a4-8b0d-4240-90ad-42801ac261eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:55.756286 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d1c6f7a4-8b0d-4240-90ad-42801ac261eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:55.757048 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d1c6f7a4-8b0d-4240-90ad-42801ac261eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:55.757476 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d1c6f7a4-8b0d-4240-90ad-42801ac261eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:55.878228 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d1c6f7a4-8b0d-4240-90ad-42801ac261eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:55.887179 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d1c6f7a4-8b0d-4240-90ad-42801ac261eb tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.142820 Oct 27 14:15:55.887808 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 827/1210] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:55 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:55.957338 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4c465a31-18d0-457d-ad86-4adc48523730 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:55.957950 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4c465a31-18d0-457d-ad86-4adc48523730 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:55.963856 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c465a31-18d0-457d-ad86-4adc48523730 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:55.964308 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c465a31-18d0-457d-ad86-4adc48523730 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:55.965079 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c465a31-18d0-457d-ad86-4adc48523730 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:55.965515 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4c465a31-18d0-457d-ad86-4adc48523730 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:56.165308 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4c465a31-18d0-457d-ad86-4adc48523730 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:56.173075 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4c465a31-18d0-457d-ad86-4adc48523730 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:56.174575 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4c465a31-18d0-457d-ad86-4adc48523730 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:56.176463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4c465a31-18d0-457d-ad86-4adc48523730 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.222850 Oct 27 14:15:56.177160 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 828/1211] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:55 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:56.904323 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9a67b39a-b9bd-456c-9caf-b6a2e2d15c80 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:56.905043 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9a67b39a-b9bd-456c-9caf-b6a2e2d15c80 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:56.911392 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a67b39a-b9bd-456c-9caf-b6a2e2d15c80 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:56.911838 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a67b39a-b9bd-456c-9caf-b6a2e2d15c80 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:56.912599 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a67b39a-b9bd-456c-9caf-b6a2e2d15c80 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:56.913029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9a67b39a-b9bd-456c-9caf-b6a2e2d15c80 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:57.033727 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9a67b39a-b9bd-456c-9caf-b6a2e2d15c80 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:57.041567 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9a67b39a-b9bd-456c-9caf-b6a2e2d15c80 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.140888 Oct 27 14:15:57.042150 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 829/1212] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:56 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:57.186268 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f673b5bd-75b5-4781-bf70-6abc42898e78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:57.186750 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f673b5bd-75b5-4781-bf70-6abc42898e78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:57.193278 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f673b5bd-75b5-4781-bf70-6abc42898e78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:57.193723 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f673b5bd-75b5-4781-bf70-6abc42898e78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:57.194488 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f673b5bd-75b5-4781-bf70-6abc42898e78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:57.194920 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f673b5bd-75b5-4781-bf70-6abc42898e78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:57.225253 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f673b5bd-75b5-4781-bf70-6abc42898e78 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments/19012f85-dcc3-423e-ad92-4054099e9012" status: 200 len: 194 microversion: 2.1 time: 0.042683 Oct 27 14:15:57.225831 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 830/1213] 10.222.0.85 () {58 vars in 1412 bytes} [Wed Oct 27 14:15:57 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments/19012f85-dcc3-423e-ad92-4054099e9012 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:15:57.230263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-6fd2de14-f2b4-4b3d-aa85-950c094a338a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:57.230855 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-6fd2de14-f2b4-4b3d-aa85-950c094a338a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:57.236419 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6fd2de14-f2b4-4b3d-aa85-950c094a338a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:57.236861 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6fd2de14-f2b4-4b3d-aa85-950c094a338a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:57.237619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6fd2de14-f2b4-4b3d-aa85-950c094a338a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:57.238081 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-6fd2de14-f2b4-4b3d-aa85-950c094a338a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:57.358660 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6fd2de14-f2b4-4b3d-aa85-950c094a338a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:57.367075 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6fd2de14-f2b4-4b3d-aa85-950c094a338a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:57.368600 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-6fd2de14-f2b4-4b3d-aa85-950c094a338a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:57.369785 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-6fd2de14-f2b4-4b3d-aa85-950c094a338a tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.143054 Oct 27 14:15:57.370340 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 831/1214] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:57 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 14:15:57.374690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-241e3b69-e21f-4ced-b285-3acf5f556253 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:57.375200 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-241e3b69-e21f-4ced-b285-3acf5f556253 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:57.381395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-241e3b69-e21f-4ced-b285-3acf5f556253 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:57.381842 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-241e3b69-e21f-4ced-b285-3acf5f556253 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:57.382609 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-241e3b69-e21f-4ced-b285-3acf5f556253 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:57.383042 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-241e3b69-e21f-4ced-b285-3acf5f556253 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:57.460555 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-241e3b69-e21f-4ced-b285-3acf5f556253 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lazy-loading 'services' on Instance uuid 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:15:57.531056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-241e3b69-e21f-4ced-b285-3acf5f556253 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "DELETE /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments/19012f85-dcc3-423e-ad92-4054099e9012" status: 202 len: 0 microversion: 2.1 time: 0.159520 Oct 27 14:15:57.531690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 832/1215] 10.222.0.85 () {58 vars in 1415 bytes} [Wed Oct 27 14:15:57 2021] DELETE /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments/19012f85-dcc3-423e-ad92-4054099e9012 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 14:15:58.058876 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-30dc23a9-f3b2-4970-9ef9-f48536c2e361 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:58.059587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-30dc23a9-f3b2-4970-9ef9-f48536c2e361 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:58.066039 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-30dc23a9-f3b2-4970-9ef9-f48536c2e361 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:58.066462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-30dc23a9-f3b2-4970-9ef9-f48536c2e361 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:58.067302 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-30dc23a9-f3b2-4970-9ef9-f48536c2e361 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:58.067714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-30dc23a9-f3b2-4970-9ef9-f48536c2e361 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:58.199968 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-30dc23a9-f3b2-4970-9ef9-f48536c2e361 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:58.207879 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-30dc23a9-f3b2-4970-9ef9-f48536c2e361 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.153155 Oct 27 14:15:58.208450 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 833/1216] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:58 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:58.388542 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a3db1d5c-4331-427a-89c0-e0acd80ffcd6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:58.389179 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a3db1d5c-4331-427a-89c0-e0acd80ffcd6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:58.397005 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a3db1d5c-4331-427a-89c0-e0acd80ffcd6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:58.397626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a3db1d5c-4331-427a-89c0-e0acd80ffcd6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:58.399070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a3db1d5c-4331-427a-89c0-e0acd80ffcd6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:58.399527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a3db1d5c-4331-427a-89c0-e0acd80ffcd6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:58.527482 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a3db1d5c-4331-427a-89c0-e0acd80ffcd6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:58.535915 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a3db1d5c-4331-427a-89c0-e0acd80ffcd6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:58.537435 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a3db1d5c-4331-427a-89c0-e0acd80ffcd6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:58.538597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a3db1d5c-4331-427a-89c0-e0acd80ffcd6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.153905 Oct 27 14:15:58.539173 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 834/1217] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:58 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:58.685860 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1b1e497b-67d5-4055-8f15-3083fb279604 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:58.686823 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1b1e497b-67d5-4055-8f15-3083fb279604 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:58.692837 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b1e497b-67d5-4055-8f15-3083fb279604 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:58.693315 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b1e497b-67d5-4055-8f15-3083fb279604 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:58.694088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b1e497b-67d5-4055-8f15-3083fb279604 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:58.694519 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1b1e497b-67d5-4055-8f15-3083fb279604 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:58.724412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1b1e497b-67d5-4055-8f15-3083fb279604 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042227 Oct 27 14:15:58.724995 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 835/1218] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:15:58 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 14:15:58.825012 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-1d0a9851-96a5-43c0-a8b3-c9bde83ef046 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:58.825919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-1d0a9851-96a5-43c0-a8b3-c9bde83ef046 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:58.832337 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d0a9851-96a5-43c0-a8b3-c9bde83ef046 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:58.832789 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d0a9851-96a5-43c0-a8b3-c9bde83ef046 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:58.833556 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d0a9851-96a5-43c0-a8b3-c9bde83ef046 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:58.833990 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-1d0a9851-96a5-43c0-a8b3-c9bde83ef046 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:58.862889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-1d0a9851-96a5-43c0-a8b3-c9bde83ef046 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041521 Oct 27 14:15:58.863409 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 836/1219] 10.222.0.85 () {58 vars in 1301 bytes} [Wed Oct 27 14:15:58 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 14:15:58.917727 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-90e312e8-39bd-44bc-adf3-a571a5bb014d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:58.918217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-90e312e8-39bd-44bc-adf3-a571a5bb014d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:58.924044 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-90e312e8-39bd-44bc-adf3-a571a5bb014d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:58.924492 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-90e312e8-39bd-44bc-adf3-a571a5bb014d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:58.925309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-90e312e8-39bd-44bc-adf3-a571a5bb014d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:58.925857 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-90e312e8-39bd-44bc-adf3-a571a5bb014d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:58.950037 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-90e312e8-39bd-44bc-adf3-a571a5bb014d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:15:59.026028 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-90e312e8-39bd-44bc-adf3-a571a5bb014d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "DELETE /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 204 len: 0 microversion: 2.1 time: 0.111643 Oct 27 14:15:59.026616 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 837/1220] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:15:58 2021] DELETE /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:15:59.035876 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-349b50ec-98c0-46ff-9f70-2337001b75d8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:59.036568 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-349b50ec-98c0-46ff-9f70-2337001b75d8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:59.042457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-349b50ec-98c0-46ff-9f70-2337001b75d8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:59.042898 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-349b50ec-98c0-46ff-9f70-2337001b75d8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:59.043693 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-349b50ec-98c0-46ff-9f70-2337001b75d8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:59.044117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-349b50ec-98c0-46ff-9f70-2337001b75d8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:59.165216 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-349b50ec-98c0-46ff-9f70-2337001b75d8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:59.172463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-349b50ec-98c0-46ff-9f70-2337001b75d8 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1552 microversion: 2.1 time: 0.141577 Oct 27 14:15:59.173029 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 838/1221] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:59 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1552 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:59.224744 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c1333bb3-4daf-4b5c-8c00-20c9abea5e62 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:59.225343 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c1333bb3-4daf-4b5c-8c00-20c9abea5e62 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:59.231623 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1333bb3-4daf-4b5c-8c00-20c9abea5e62 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:59.232058 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1333bb3-4daf-4b5c-8c00-20c9abea5e62 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:59.232809 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1333bb3-4daf-4b5c-8c00-20c9abea5e62 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:59.233233 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c1333bb3-4daf-4b5c-8c00-20c9abea5e62 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:59.358163 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c1333bb3-4daf-4b5c-8c00-20c9abea5e62 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:59.365687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c1333bb3-4daf-4b5c-8c00-20c9abea5e62 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.144695 Oct 27 14:15:59.366250 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 839/1222] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:15:59 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:15:59.557230 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-677b069e-7ba5-42e9-bb1d-a2c4de3266fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:15:59.557840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-677b069e-7ba5-42e9-bb1d-a2c4de3266fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:15:59.563826 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-677b069e-7ba5-42e9-bb1d-a2c4de3266fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:59.564272 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-677b069e-7ba5-42e9-bb1d-a2c4de3266fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:59.565038 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-677b069e-7ba5-42e9-bb1d-a2c4de3266fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:59.565474 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-677b069e-7ba5-42e9-bb1d-a2c4de3266fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:59.692083 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-677b069e-7ba5-42e9-bb1d-a2c4de3266fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:59.700467 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-677b069e-7ba5-42e9-bb1d-a2c4de3266fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:59.702051 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-677b069e-7ba5-42e9-bb1d-a2c4de3266fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:15:59.703455 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-677b069e-7ba5-42e9-bb1d-a2c4de3266fc tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.149977 Oct 27 14:15:59.704081 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 840/1223] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:15:59 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:15:59.708687 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-87a4f728-d347-48da-a9b6-18949e7fdf72 req-b21980f1-b0ef-4234-a081-817c9c5d895c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e905cb-2edf-4221-933f-a7c59abcd554", "name": "network-vif-plugged", "status": "completed", "tag": "7cb0b496-4ac4-4e36-a183-d35a08ddccae"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:15:59.710270 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:15:59.710270 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:15:59.716992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-87a4f728-d347-48da-a9b6-18949e7fdf72 req-b21980f1-b0ef-4234-a081-817c9c5d895c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:15:59.717420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-87a4f728-d347-48da-a9b6-18949e7fdf72 req-b21980f1-b0ef-4234-a081-817c9c5d895c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:15:59.728492 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-87a4f728-d347-48da-a9b6-18949e7fdf72 req-b21980f1-b0ef-4234-a081-817c9c5d895c service nova] Creating event network-vif-plugged:7cb0b496-4ac4-4e36-a183-d35a08ddccae for instance e2e905cb-2edf-4221-933f-a7c59abcd554 on hv-cinder-81566 Oct 27 14:15:59.733145 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-87a4f728-d347-48da-a9b6-18949e7fdf72 req-b21980f1-b0ef-4234-a081-817c9c5d895c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027983 Oct 27 14:15:59.733812 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 841/1224] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:15:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:16:00.189241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ae03a68a-1b51-4f40-b25a-2080ef4473c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:00.189880 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ae03a68a-1b51-4f40-b25a-2080ef4473c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:00.196164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ae03a68a-1b51-4f40-b25a-2080ef4473c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:00.196605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ae03a68a-1b51-4f40-b25a-2080ef4473c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:00.197357 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ae03a68a-1b51-4f40-b25a-2080ef4473c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:00.197784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ae03a68a-1b51-4f40-b25a-2080ef4473c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:00.323467 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ae03a68a-1b51-4f40-b25a-2080ef4473c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:00.330737 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ae03a68a-1b51-4f40-b25a-2080ef4473c2 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1552 microversion: 2.1 time: 0.145596 Oct 27 14:16:00.331529 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 842/1225] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:00 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1552 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:00.381919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e543a62d-2d3c-4175-bb0f-fc571563239d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:00.382544 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e543a62d-2d3c-4175-bb0f-fc571563239d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:00.388339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e543a62d-2d3c-4175-bb0f-fc571563239d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:00.388817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e543a62d-2d3c-4175-bb0f-fc571563239d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:00.389535 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e543a62d-2d3c-4175-bb0f-fc571563239d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:00.389965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e543a62d-2d3c-4175-bb0f-fc571563239d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:00.518784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-e543a62d-2d3c-4175-bb0f-fc571563239d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:00.527322 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e543a62d-2d3c-4175-bb0f-fc571563239d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.149144 Oct 27 14:16:00.527899 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 843/1226] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:00 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:00.721673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-018dab6d-26da-437b-b417-eaf8fedb39fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:00.722191 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-018dab6d-26da-437b-b417-eaf8fedb39fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:00.728094 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-018dab6d-26da-437b-b417-eaf8fedb39fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:00.728715 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-018dab6d-26da-437b-b417-eaf8fedb39fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:00.729483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-018dab6d-26da-437b-b417-eaf8fedb39fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:00.729917 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-018dab6d-26da-437b-b417-eaf8fedb39fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:00.850408 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-018dab6d-26da-437b-b417-eaf8fedb39fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:00.858178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-018dab6d-26da-437b-b417-eaf8fedb39fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:00.859695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-018dab6d-26da-437b-b417-eaf8fedb39fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:00.860829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-018dab6d-26da-437b-b417-eaf8fedb39fe tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1730 microversion: 2.20 time: 0.142975 Oct 27 14:16:00.861387 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 844/1227] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:16:00 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1730 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:16:01.348562 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fb4a5d05-d734-4b0f-bec7-e8f655bdc718 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:01.349237 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fb4a5d05-d734-4b0f-bec7-e8f655bdc718 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:01.355649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fb4a5d05-d734-4b0f-bec7-e8f655bdc718 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:01.356164 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fb4a5d05-d734-4b0f-bec7-e8f655bdc718 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:01.356865 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fb4a5d05-d734-4b0f-bec7-e8f655bdc718 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:01.357299 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fb4a5d05-d734-4b0f-bec7-e8f655bdc718 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:01.563605 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-fb4a5d05-d734-4b0f-bec7-e8f655bdc718 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:01.571884 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fb4a5d05-d734-4b0f-bec7-e8f655bdc718 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1552 microversion: 2.1 time: 0.227079 Oct 27 14:16:01.572461 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 845/1228] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:01 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1552 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:01.577115 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4950f200-91f2-47a6-8c99-8cd1ada7edb5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:01.577689 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4950f200-91f2-47a6-8c99-8cd1ada7edb5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:01.583461 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4950f200-91f2-47a6-8c99-8cd1ada7edb5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:01.584190 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4950f200-91f2-47a6-8c99-8cd1ada7edb5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:01.585060 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4950f200-91f2-47a6-8c99-8cd1ada7edb5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:01.585491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4950f200-91f2-47a6-8c99-8cd1ada7edb5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:01.800178 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4950f200-91f2-47a6-8c99-8cd1ada7edb5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:01.808651 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4950f200-91f2-47a6-8c99-8cd1ada7edb5 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.235015 Oct 27 14:16:01.809220 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 846/1229] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:01 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:16:01.879072 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bca37ec1-d4db-497c-8840-0edc716eb72b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:01.879747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-bca37ec1-d4db-497c-8840-0edc716eb72b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:01.886130 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bca37ec1-d4db-497c-8840-0edc716eb72b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:01.886576 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bca37ec1-d4db-497c-8840-0edc716eb72b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:01.887591 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bca37ec1-d4db-497c-8840-0edc716eb72b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:01.888202 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-bca37ec1-d4db-497c-8840-0edc716eb72b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:02.099975 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bca37ec1-d4db-497c-8840-0edc716eb72b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:02.108803 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bca37ec1-d4db-497c-8840-0edc716eb72b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:02.110584 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-bca37ec1-d4db-497c-8840-0edc716eb72b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:02.111814 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bca37ec1-d4db-497c-8840-0edc716eb72b tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1717 microversion: 2.20 time: 0.236593 Oct 27 14:16:02.112450 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 847/1230] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:16:01 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1717 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:16:02.590059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:02.591503 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:02.598466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:02.599038 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:02.603802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:02.604969 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:02.639591 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:02.640423 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:02.641082 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.objects.instance [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lazy-loading 'fault' on Instance uuid 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 {{(pid=115931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 27 14:16:02.684124 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff5c722cc57744d886ba552ce2571745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81aae1f72a0c4ea9918b36e3c7aef02b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:02.691734 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-071f27ac-1f92-4baa-aaa0-ee0d756e7289 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 200 len: 1326 microversion: 2.1 time: 0.105254 Oct 27 14:16:02.692311 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 848/1231] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:02 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:02.825646 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3222ac09-d509-4431-a867-fec8a325146a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:02.826217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3222ac09-d509-4431-a867-fec8a325146a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:02.832108 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3222ac09-d509-4431-a867-fec8a325146a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:02.832561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3222ac09-d509-4431-a867-fec8a325146a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:02.833825 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3222ac09-d509-4431-a867-fec8a325146a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:02.834318 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3222ac09-d509-4431-a867-fec8a325146a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:02.969580 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3222ac09-d509-4431-a867-fec8a325146a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:02.978480 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3222ac09-d509-4431-a867-fec8a325146a tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.156469 Oct 27 14:16:02.979373 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 849/1232] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:02 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:16:03.710521 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c35a6462-51b7-4cd0-a9df-74588168dc5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:03.711219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c35a6462-51b7-4cd0-a9df-74588168dc5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:03.721036 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c35a6462-51b7-4cd0-a9df-74588168dc5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:03.721767 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c35a6462-51b7-4cd0-a9df-74588168dc5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:03.722905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c35a6462-51b7-4cd0-a9df-74588168dc5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:03.723368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c35a6462-51b7-4cd0-a9df-74588168dc5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:03.737692 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-c35a6462-51b7-4cd0-a9df-74588168dc5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] HTTP exception thrown: Instance 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 could not be found. Oct 27 14:16:03.738285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c35a6462-51b7-4cd0-a9df-74588168dc5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Returning 404 to user: Instance 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:16:03.739117 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c35a6462-51b7-4cd0-a9df-74588168dc5d tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 404 len: 111 microversion: 2.1 time: 0.033683 Oct 27 14:16:03.739683 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 850/1233] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:03 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:16:03.748352 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fbd03dff-66b9-4dd2-98da-ef11bc8b0e0a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '.version_select at 0x7f45707b81f0>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:03.770419 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fbd03dff-66b9-4dd2-98da-ef11bc8b0e0a tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159898855" status: 202 len: 0 microversion: 2.1 time: 0.025449 Oct 27 14:16:03.771599 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 851/1234] 10.222.0.85 () {58 vars in 1220 bytes} [Wed Oct 27 14:16:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159898855 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:16:03.995795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4fb35e62-674c-437d-bc94-0c2db8d6660c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:03.996441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4fb35e62-674c-437d-bc94-0c2db8d6660c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:04.002487 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fb35e62-674c-437d-bc94-0c2db8d6660c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:04.002933 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fb35e62-674c-437d-bc94-0c2db8d6660c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:04.003802 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fb35e62-674c-437d-bc94-0c2db8d6660c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:04.004236 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4fb35e62-674c-437d-bc94-0c2db8d6660c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:04.194184 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-4fb35e62-674c-437d-bc94-0c2db8d6660c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:04.202339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4fb35e62-674c-437d-bc94-0c2db8d6660c tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.210206 Oct 27 14:16:04.202911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 852/1235] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:03 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:05.219586 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-f310b682-4a6d-4ceb-8170-b32d5cec978d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:05.220276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-f310b682-4a6d-4ceb-8170-b32d5cec978d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:05.226683 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f310b682-4a6d-4ceb-8170-b32d5cec978d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:05.227118 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f310b682-4a6d-4ceb-8170-b32d5cec978d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:05.227903 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f310b682-4a6d-4ceb-8170-b32d5cec978d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:05.228327 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-f310b682-4a6d-4ceb-8170-b32d5cec978d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:05.350368 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-f310b682-4a6d-4ceb-8170-b32d5cec978d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:05.357718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-f310b682-4a6d-4ceb-8170-b32d5cec978d tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.141771 Oct 27 14:16:05.358287 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 853/1236] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:05 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:06.375222 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-728e30d3-f836-4bdd-966e-9a4ad3a570a6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:06.375946 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-728e30d3-f836-4bdd-966e-9a4ad3a570a6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:06.382852 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-728e30d3-f836-4bdd-966e-9a4ad3a570a6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:06.383331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-728e30d3-f836-4bdd-966e-9a4ad3a570a6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:06.384100 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-728e30d3-f836-4bdd-966e-9a4ad3a570a6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:06.384538 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-728e30d3-f836-4bdd-966e-9a4ad3a570a6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:06.506195 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-728e30d3-f836-4bdd-966e-9a4ad3a570a6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:06.515587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-728e30d3-f836-4bdd-966e-9a4ad3a570a6 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.144404 Oct 27 14:16:06.516193 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 854/1237] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:06 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:06.758319 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-060c9e2d-34e8-42ff-ac6a-e4301c3480a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:06.758902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-060c9e2d-34e8-42ff-ac6a-e4301c3480a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:06.764907 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-060c9e2d-34e8-42ff-ac6a-e4301c3480a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:06.765359 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-060c9e2d-34e8-42ff-ac6a-e4301c3480a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:06.766134 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-060c9e2d-34e8-42ff-ac6a-e4301c3480a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:06.766572 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-060c9e2d-34e8-42ff-ac6a-e4301c3480a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:06.782245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-060c9e2d-34e8-42ff-ac6a-e4301c3480a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] HTTP exception thrown: Instance 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 could not be found. Oct 27 14:16:06.782865 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-060c9e2d-34e8-42ff-ac6a-e4301c3480a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Returning 404 to user: Instance 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:16:06.783730 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-060c9e2d-34e8-42ff-ac6a-e4301c3480a7 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "DELETE /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 404 len: 111 microversion: 2.1 time: 0.029661 Oct 27 14:16:06.784290 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 855/1238] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:16:06 2021] DELETE /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:16:06.792913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-46f3fe0f-2994-492e-9cbd-5070decd7882 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:06.793965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-46f3fe0f-2994-492e-9cbd-5070decd7882 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:06.800364 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-46f3fe0f-2994-492e-9cbd-5070decd7882 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:06.800815 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-46f3fe0f-2994-492e-9cbd-5070decd7882 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:06.801593 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-46f3fe0f-2994-492e-9cbd-5070decd7882 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:06.802025 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-46f3fe0f-2994-492e-9cbd-5070decd7882 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:06.815817 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-46f3fe0f-2994-492e-9cbd-5070decd7882 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] HTTP exception thrown: Instance 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 could not be found. Oct 27 14:16:06.816412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-46f3fe0f-2994-492e-9cbd-5070decd7882 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Returning 404 to user: Instance 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:16:06.817235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-46f3fe0f-2994-492e-9cbd-5070decd7882 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2" status: 404 len: 111 microversion: 2.1 time: 0.027944 Oct 27 14:16:06.817765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 856/1239] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:06 2021] GET /compute/v2.1/servers/35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:16:07.532764 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-45ff7979-2060-46c3-8285-e99f88e9a9e3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:07.533567 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-45ff7979-2060-46c3-8285-e99f88e9a9e3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:07.540293 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45ff7979-2060-46c3-8285-e99f88e9a9e3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:07.540463 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45ff7979-2060-46c3-8285-e99f88e9a9e3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:07.541235 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45ff7979-2060-46c3-8285-e99f88e9a9e3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:07.541669 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-45ff7979-2060-46c3-8285-e99f88e9a9e3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:07.667792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-45ff7979-2060-46c3-8285-e99f88e9a9e3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:07.675238 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-45ff7979-2060-46c3-8285-e99f88e9a9e3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.146157 Oct 27 14:16:07.676123 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 857/1240] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:07 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:07.685157 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-9f3b1bb9-83cc-4e94-bc05-4092d0a365f7 req-2ed6aa34-85f4-4459-a810-3fb79e93a115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb7ac2c-4e45-46c4-8b56-062aac14258b", "name": "network-vif-plugged", "status": "completed", "tag": "e5f6c633-3fb1-4c33-8bba-2b47432ace5a"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:16:07.686774 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:16:07.686774 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:16:07.695179 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-9f3b1bb9-83cc-4e94-bc05-4092d0a365f7 req-2ed6aa34-85f4-4459-a810-3fb79e93a115 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:07.695603 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-9f3b1bb9-83cc-4e94-bc05-4092d0a365f7 req-2ed6aa34-85f4-4459-a810-3fb79e93a115 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:07.707533 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-9f3b1bb9-83cc-4e94-bc05-4092d0a365f7 req-2ed6aa34-85f4-4459-a810-3fb79e93a115 service nova] Creating event network-vif-plugged:e5f6c633-3fb1-4c33-8bba-2b47432ace5a for instance 0cb7ac2c-4e45-46c4-8b56-062aac14258b on hv-cinder-81566 Oct 27 14:16:07.713472 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-9f3b1bb9-83cc-4e94-bc05-4092d0a365f7 req-2ed6aa34-85f4-4459-a810-3fb79e93a115 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031757 Oct 27 14:16:07.714065 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 858/1241] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:16:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:16:07.946875 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4841d527-2565-44a4-97c5-8ef969425fbd tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:07.947476 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-4841d527-2565-44a4-97c5-8ef969425fbd tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:07.954107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4841d527-2565-44a4-97c5-8ef969425fbd tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:07.954690 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4841d527-2565-44a4-97c5-8ef969425fbd tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:07.955353 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4841d527-2565-44a4-97c5-8ef969425fbd tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:07.955793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-4841d527-2565-44a4-97c5-8ef969425fbd tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:07.969863 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-4841d527-2565-44a4-97c5-8ef969425fbd tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] HTTP exception thrown: Instance 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 could not be found. Oct 27 14:16:07.970460 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-4841d527-2565-44a4-97c5-8ef969425fbd tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Returning 404 to user: Instance 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:16:07.971394 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-4841d527-2565-44a4-97c5-8ef969425fbd tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "DELETE /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 404 len: 111 microversion: 2.1 time: 0.028654 Oct 27 14:16:07.971954 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 859/1242] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:16:07 2021] DELETE /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:16:07.980136 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e983ddbd-0696-4647-a495-176c7a42f7b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:07.980742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-e983ddbd-0696-4647-a495-176c7a42f7b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] [instance: 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:07.986531 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e983ddbd-0696-4647-a495-176c7a42f7b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:07.986965 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e983ddbd-0696-4647-a495-176c7a42f7b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:07.987766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e983ddbd-0696-4647-a495-176c7a42f7b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:07.988203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-e983ddbd-0696-4647-a495-176c7a42f7b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:08.002181 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-e983ddbd-0696-4647-a495-176c7a42f7b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] HTTP exception thrown: Instance 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 could not be found. Oct 27 14:16:08.002793 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-e983ddbd-0696-4647-a495-176c7a42f7b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] Returning 404 to user: Instance 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:16:08.003749 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-e983ddbd-0696-4647-a495-176c7a42f7b6 tempest-AttachVolumeTestJSON-1533219795 tempest-AttachVolumeTestJSON-1533219795-project] 10.222.0.85 "GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8" status: 404 len: 111 microversion: 2.1 time: 0.027201 Oct 27 14:16:08.004300 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 860/1243] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:07 2021] GET /compute/v2.1/servers/396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:16:08.692848 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5fa70260-39e6-4633-82f2-67c73c2ce0c9 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:08.693637 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5fa70260-39e6-4633-82f2-67c73c2ce0c9 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:08.700207 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5fa70260-39e6-4633-82f2-67c73c2ce0c9 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:08.700659 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5fa70260-39e6-4633-82f2-67c73c2ce0c9 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:08.701444 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5fa70260-39e6-4633-82f2-67c73c2ce0c9 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:08.701885 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5fa70260-39e6-4633-82f2-67c73c2ce0c9 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:08.951014 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5fa70260-39e6-4633-82f2-67c73c2ce0c9 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:08.959357 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5fa70260-39e6-4633-82f2-67c73c2ce0c9 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1576 microversion: 2.1 time: 0.269474 Oct 27 14:16:08.963720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 861/1244] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:08 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1576 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:09.977416 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-29287c57-abcb-4b19-93f9-08a0e1fd9f58 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:09.978750 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-29287c57-abcb-4b19-93f9-08a0e1fd9f58 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:09.985850 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29287c57-abcb-4b19-93f9-08a0e1fd9f58 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:09.986622 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29287c57-abcb-4b19-93f9-08a0e1fd9f58 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:09.987776 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29287c57-abcb-4b19-93f9-08a0e1fd9f58 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:09.988450 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-29287c57-abcb-4b19-93f9-08a0e1fd9f58 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:10.197308 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-29287c57-abcb-4b19-93f9-08a0e1fd9f58 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:10.205307 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-29287c57-abcb-4b19-93f9-08a0e1fd9f58 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1563 microversion: 2.1 time: 0.232022 Oct 27 14:16:10.205883 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 862/1245] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:09 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:29.947625 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:16:29.948610 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Wed Oct 27 14:16:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Oct 27 14:16:30.672484 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-119944470", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1521029144", "security_groups": [{"name": "tempest-secgroup-smoke-867368291"}], "block_device_mapping_v2": [{"uuid": "99d3eb05-3af7-4f22-ad5f-d483885a05cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9af09723-d748-420c-9b75-4c97db8a5445"}]}} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:16:30.793749 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.network.neutron [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] validate_networks() for [('9af09723-d748-420c-9b75-4c97db8a5445', None, None, None, None, None)] {{(pid=115931) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 27 14:16:31.203478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Flavor limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 14:16:31.203938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Image limits 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 14:16:31.204429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Flavor pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 14:16:31.204932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Image pref 0:0:0 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 14:16:31.205341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.virt.hardware [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 14:16:31.214306 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:31.214766 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:31.215642 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:31.216081 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:31.233684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Getting quotas for project 925d32172c5f44168c2eddeffc0a7da1. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 27 14:16:31.237679 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.quota [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Getting quotas for user aa9c479260384120a439e7f8c2dd122f and project 925d32172c5f44168c2eddeffc0a7da1. Resources: {'cores', 'instances', 'ram'} {{(pid=115931) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 27 14:16:31.297056 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Going to run 1 instances... {{(pid=115931) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 27 14:16:31.299277 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99d3eb05-3af7-4f22-ad5f-d483885a05cd',volume_size=None,volume_type=None)] {{(pid=115931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 27 14:16:31.427430 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cb1c8409-a577-4d85-8df5-aafa506c7617 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.758696 Oct 27 14:16:31.428785 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 863/1246] 10.222.0.85 () {60 vars in 1146 bytes} [Wed Oct 27 14:16:30 2021] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 14:16:31.439089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-30b73ab9-9261-4302-a90f-a8f7a8f6b586 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:31.440414 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-30b73ab9-9261-4302-a90f-a8f7a8f6b586 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:31.499047 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-30b73ab9-9261-4302-a90f-a8f7a8f6b586 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:31.508245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-30b73ab9-9261-4302-a90f-a8f7a8f6b586 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1094 microversion: 2.1 time: 0.073062 Oct 27 14:16:31.509286 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 864/1247] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:31 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:32.525204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-744a70b6-e3bd-446a-9f9f-d11f22c64053 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:32.525820 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-744a70b6-e3bd-446a-9f9f-d11f22c64053 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:32.532840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-744a70b6-e3bd-446a-9f9f-d11f22c64053 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:32.533285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-744a70b6-e3bd-446a-9f9f-d11f22c64053 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:32.534116 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-744a70b6-e3bd-446a-9f9f-d11f22c64053 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:32.534478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-744a70b6-e3bd-446a-9f9f-d11f22c64053 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:32.603672 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-744a70b6-e3bd-446a-9f9f-d11f22c64053 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:32.611546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-744a70b6-e3bd-446a-9f9f-d11f22c64053 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1210 microversion: 2.1 time: 0.090229 Oct 27 14:16:32.612246 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 865/1248] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:32 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:16:33.628978 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b17d5439-87b5-4af4-a2a0-ebd3fe814019 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:33.629656 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b17d5439-87b5-4af4-a2a0-ebd3fe814019 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:33.638152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b17d5439-87b5-4af4-a2a0-ebd3fe814019 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:33.640918 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b17d5439-87b5-4af4-a2a0-ebd3fe814019 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:33.641747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b17d5439-87b5-4af4-a2a0-ebd3fe814019 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:33.642181 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b17d5439-87b5-4af4-a2a0-ebd3fe814019 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:33.883808 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b17d5439-87b5-4af4-a2a0-ebd3fe814019 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:33.891467 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b17d5439-87b5-4af4-a2a0-ebd3fe814019 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.266133 Oct 27 14:16:33.892046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 866/1249] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:33 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:16:34.908790 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-92056e96-99f3-4403-8c8a-b08c58fa6f49 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:34.909471 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-92056e96-99f3-4403-8c8a-b08c58fa6f49 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:34.915735 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92056e96-99f3-4403-8c8a-b08c58fa6f49 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:34.916188 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92056e96-99f3-4403-8c8a-b08c58fa6f49 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:34.916957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92056e96-99f3-4403-8c8a-b08c58fa6f49 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:34.917393 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-92056e96-99f3-4403-8c8a-b08c58fa6f49 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:35.042472 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-92056e96-99f3-4403-8c8a-b08c58fa6f49 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:35.050172 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-92056e96-99f3-4403-8c8a-b08c58fa6f49 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.145183 Oct 27 14:16:35.050740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 867/1250] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:34 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:36.066908 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c24d29b6-f4bf-4ec2-a0d6-96356958700f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:36.067599 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c24d29b6-f4bf-4ec2-a0d6-96356958700f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:36.074720 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c24d29b6-f4bf-4ec2-a0d6-96356958700f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:36.075196 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c24d29b6-f4bf-4ec2-a0d6-96356958700f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:36.075978 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c24d29b6-f4bf-4ec2-a0d6-96356958700f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:36.076394 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c24d29b6-f4bf-4ec2-a0d6-96356958700f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:36.205204 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c24d29b6-f4bf-4ec2-a0d6-96356958700f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:36.213001 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c24d29b6-f4bf-4ec2-a0d6-96356958700f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.149711 Oct 27 14:16:36.213587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 868/1251] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:36 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:37.229680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-cc9b93bd-6906-4c86-93f3-2253e8fca049 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:37.230404 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-cc9b93bd-6906-4c86-93f3-2253e8fca049 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:37.236664 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cc9b93bd-6906-4c86-93f3-2253e8fca049 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:37.237107 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cc9b93bd-6906-4c86-93f3-2253e8fca049 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:37.237877 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cc9b93bd-6906-4c86-93f3-2253e8fca049 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:37.238311 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-cc9b93bd-6906-4c86-93f3-2253e8fca049 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:37.363805 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-cc9b93bd-6906-4c86-93f3-2253e8fca049 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:37.371498 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-cc9b93bd-6906-4c86-93f3-2253e8fca049 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.145456 Oct 27 14:16:37.372123 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 869/1252] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:37 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:38.388110 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-39862a75-c555-42a3-b31d-325956cb8df6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:38.388792 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-39862a75-c555-42a3-b31d-325956cb8df6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:38.395026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39862a75-c555-42a3-b31d-325956cb8df6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:38.395504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39862a75-c555-42a3-b31d-325956cb8df6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:38.396275 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39862a75-c555-42a3-b31d-325956cb8df6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:38.396709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-39862a75-c555-42a3-b31d-325956cb8df6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:38.529849 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-39862a75-c555-42a3-b31d-325956cb8df6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:38.537469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-39862a75-c555-42a3-b31d-325956cb8df6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.153279 Oct 27 14:16:38.538070 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 870/1253] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:38 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:39.555396 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2259c416-71d8-4589-ab80-3a7b59ba4436 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:39.556073 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2259c416-71d8-4589-ab80-3a7b59ba4436 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:39.563462 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2259c416-71d8-4589-ab80-3a7b59ba4436 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:39.563960 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2259c416-71d8-4589-ab80-3a7b59ba4436 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:39.564840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2259c416-71d8-4589-ab80-3a7b59ba4436 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:39.565280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2259c416-71d8-4589-ab80-3a7b59ba4436 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:39.690901 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2259c416-71d8-4589-ab80-3a7b59ba4436 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:39.698940 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2259c416-71d8-4589-ab80-3a7b59ba4436 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.147361 Oct 27 14:16:39.699557 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 871/1254] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:39 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:40.716264 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-10162251-24cc-418d-94d1-47ef47f56243 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:40.716925 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-10162251-24cc-418d-94d1-47ef47f56243 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:40.723287 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-10162251-24cc-418d-94d1-47ef47f56243 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:40.723738 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-10162251-24cc-418d-94d1-47ef47f56243 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:40.724526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-10162251-24cc-418d-94d1-47ef47f56243 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:40.724953 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-10162251-24cc-418d-94d1-47ef47f56243 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:40.853756 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-10162251-24cc-418d-94d1-47ef47f56243 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:40.861074 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-10162251-24cc-418d-94d1-47ef47f56243 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.148672 Oct 27 14:16:40.861642 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 872/1255] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:40 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:41.878981 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-71632765-2b3f-434e-9a93-615c24000e86 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:41.879637 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-71632765-2b3f-434e-9a93-615c24000e86 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:41.886577 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-71632765-2b3f-434e-9a93-615c24000e86 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:41.887024 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-71632765-2b3f-434e-9a93-615c24000e86 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:41.887815 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-71632765-2b3f-434e-9a93-615c24000e86 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:41.888241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-71632765-2b3f-434e-9a93-615c24000e86 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:42.009714 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-71632765-2b3f-434e-9a93-615c24000e86 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:42.017046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-71632765-2b3f-434e-9a93-615c24000e86 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.141911 Oct 27 14:16:42.017615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 873/1256] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:41 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:42.300746 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-83d97093-f326-4dd3-bb61-c5861d6fd705 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:42.301699 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-83d97093-f326-4dd3-bb61-c5861d6fd705 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:42.307916 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-83d97093-f326-4dd3-bb61-c5861d6fd705 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:42.308367 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-83d97093-f326-4dd3-bb61-c5861d6fd705 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:42.309133 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-83d97093-f326-4dd3-bb61-c5861d6fd705 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:42.309561 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-83d97093-f326-4dd3-bb61-c5861d6fd705 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:42.337941 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-83d97093-f326-4dd3-bb61-c5861d6fd705 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040933 Oct 27 14:16:42.338492 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 874/1257] 10.222.0.85 () {60 vars in 1342 bytes} [Wed Oct 27 14:16:42 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:42.392882 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-fa05ba46-8099-4d52-9e1a-712a200c0f33 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:42.393382 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fa05ba46-8099-4d52-9e1a-712a200c0f33 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:42.399532 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa05ba46-8099-4d52-9e1a-712a200c0f33 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:42.399982 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa05ba46-8099-4d52-9e1a-712a200c0f33 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:42.401036 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa05ba46-8099-4d52-9e1a-712a200c0f33 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:42.401466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-fa05ba46-8099-4d52-9e1a-712a200c0f33 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:42.426038 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-fa05ba46-8099-4d52-9e1a-712a200c0f33 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:16:42.503974 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-fa05ba46-8099-4d52-9e1a-712a200c0f33 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 204 len: 0 microversion: 2.20 time: 0.113833 Oct 27 14:16:42.505373 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 875/1258] 10.222.0.85 () {60 vars in 1279 bytes} [Wed Oct 27 14:16:42 2021] DELETE /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 14:16:42.515226 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ba127703-2d27-4935-88b8-01410a2e1e89 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:42.516390 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ba127703-2d27-4935-88b8-01410a2e1e89 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:42.521953 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ba127703-2d27-4935-88b8-01410a2e1e89 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:42.522398 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ba127703-2d27-4935-88b8-01410a2e1e89 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:42.523196 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ba127703-2d27-4935-88b8-01410a2e1e89 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:42.523667 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ba127703-2d27-4935-88b8-01410a2e1e89 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:42.656300 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ba127703-2d27-4935-88b8-01410a2e1e89 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:42.665366 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ba127703-2d27-4935-88b8-01410a2e1e89 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:42.667033 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-ba127703-2d27-4935-88b8-01410a2e1e89 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:42.668564 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ba127703-2d27-4935-88b8-01410a2e1e89 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.158486 Oct 27 14:16:42.669113 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 876/1259] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:16:42 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:16:43.033379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d3f24b91-d474-46fc-b526-4200d652544a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:43.034046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d3f24b91-d474-46fc-b526-4200d652544a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:43.041386 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3f24b91-d474-46fc-b526-4200d652544a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:43.041967 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3f24b91-d474-46fc-b526-4200d652544a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:43.042892 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3f24b91-d474-46fc-b526-4200d652544a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:43.043421 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d3f24b91-d474-46fc-b526-4200d652544a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:43.171251 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d3f24b91-d474-46fc-b526-4200d652544a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:43.179521 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d3f24b91-d474-46fc-b526-4200d652544a tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.149690 Oct 27 14:16:43.180640 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 877/1260] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:43 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:43.686742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-98bb6408-ca98-45bd-b1bf-fd89364b5e4d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:43.687371 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-98bb6408-ca98-45bd-b1bf-fd89364b5e4d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:43.693219 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-98bb6408-ca98-45bd-b1bf-fd89364b5e4d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:43.693662 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-98bb6408-ca98-45bd-b1bf-fd89364b5e4d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:43.694433 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-98bb6408-ca98-45bd-b1bf-fd89364b5e4d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:43.694905 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-98bb6408-ca98-45bd-b1bf-fd89364b5e4d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:43.817860 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-98bb6408-ca98-45bd-b1bf-fd89364b5e4d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:43.826255 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-98bb6408-ca98-45bd-b1bf-fd89364b5e4d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:43.827800 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-98bb6408-ca98-45bd-b1bf-fd89364b5e4d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:43.828946 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-98bb6408-ca98-45bd-b1bf-fd89364b5e4d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1723 microversion: 2.20 time: 0.145956 Oct 27 14:16:43.829501 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 878/1261] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:16:43 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:16:44.197022 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d65a1dbc-382c-408f-8de2-4f3302efceb3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:44.197711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d65a1dbc-382c-408f-8de2-4f3302efceb3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:44.203840 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d65a1dbc-382c-408f-8de2-4f3302efceb3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:44.204283 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d65a1dbc-382c-408f-8de2-4f3302efceb3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:44.205046 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d65a1dbc-382c-408f-8de2-4f3302efceb3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:44.205479 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d65a1dbc-382c-408f-8de2-4f3302efceb3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:44.356077 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d65a1dbc-382c-408f-8de2-4f3302efceb3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:44.364309 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d65a1dbc-382c-408f-8de2-4f3302efceb3 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.171079 Oct 27 14:16:44.365461 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 879/1262] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:44 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:44.847642 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-2ec80571-651f-43e4-af18-00d479d0a7ea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:44.848245 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-2ec80571-651f-43e4-af18-00d479d0a7ea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:44.855120 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2ec80571-651f-43e4-af18-00d479d0a7ea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:44.855589 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2ec80571-651f-43e4-af18-00d479d0a7ea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:44.856355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2ec80571-651f-43e4-af18-00d479d0a7ea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:44.856778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-2ec80571-651f-43e4-af18-00d479d0a7ea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:44.949909 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2ec80571-651f-43e4-af18-00d479d0a7ea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:44.957839 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2ec80571-651f-43e4-af18-00d479d0a7ea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:44.959388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-2ec80571-651f-43e4-af18-00d479d0a7ea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd777531f3785498189495db0e1932c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84e18e41f634c02ac87674f5f6da28d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:44.960536 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-2ec80571-651f-43e4-af18-00d479d0a7ea tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 200 len: 1656 microversion: 2.20 time: 0.116660 Oct 27 14:16:44.961587 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 880/1263] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:16:44 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 1656 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 14:16:45.382724 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7105b08b-223d-4535-b33c-4707a77d7ce6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:45.385199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7105b08b-223d-4535-b33c-4707a77d7ce6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:45.392199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7105b08b-223d-4535-b33c-4707a77d7ce6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:45.392658 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7105b08b-223d-4535-b33c-4707a77d7ce6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:45.393486 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7105b08b-223d-4535-b33c-4707a77d7ce6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:45.393932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7105b08b-223d-4535-b33c-4707a77d7ce6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:45.563244 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7105b08b-223d-4535-b33c-4707a77d7ce6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:45.571478 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7105b08b-223d-4535-b33c-4707a77d7ce6 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.192616 Oct 27 14:16:45.572053 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 881/1264] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:45 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:45.979975 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-08bf0293-a374-4451-8ef0-057351ec54d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:45.984680 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-08bf0293-a374-4451-8ef0-057351ec54d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:45.994596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-08bf0293-a374-4451-8ef0-057351ec54d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:45.995043 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-08bf0293-a374-4451-8ef0-057351ec54d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:45.996026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-08bf0293-a374-4451-8ef0-057351ec54d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:45.996453 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-08bf0293-a374-4451-8ef0-057351ec54d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:46.012284 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-08bf0293-a374-4451-8ef0-057351ec54d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] HTTP exception thrown: Instance e2e905cb-2edf-4221-933f-a7c59abcd554 could not be found. Oct 27 14:16:46.012879 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-08bf0293-a374-4451-8ef0-057351ec54d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Returning 404 to user: Instance e2e905cb-2edf-4221-933f-a7c59abcd554 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:16:46.013706 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-08bf0293-a374-4451-8ef0-057351ec54d1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 404 len: 111 microversion: 2.20 time: 0.037649 Oct 27 14:16:46.014447 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 882/1265] 10.222.0.85 () {60 vars in 1276 bytes} [Wed Oct 27 14:16:45 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 14:16:46.023043 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-bd6d5db8-cba9-43b1-80eb-7c7848954ff6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '.version_select at 0x7f4574daf040>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:46.042924 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-bd6d5db8-cba9-43b1-80eb-7c7848954ff6 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-742587953" status: 204 len: 0 microversion: 2.20 time: 0.023640 Oct 27 14:16:46.043556 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 883/1266] 10.222.0.85 () {60 vars in 1258 bytes} [Wed Oct 27 14:16:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-742587953 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 14:16:46.588796 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-23643754-7d00-46b9-80cd-e097dd146eff tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:46.590132 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-23643754-7d00-46b9-80cd-e097dd146eff tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:46.604747 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-23643754-7d00-46b9-80cd-e097dd146eff tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:46.605564 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-23643754-7d00-46b9-80cd-e097dd146eff tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:46.606366 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-23643754-7d00-46b9-80cd-e097dd146eff tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:46.607002 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-23643754-7d00-46b9-80cd-e097dd146eff tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:46.742784 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-23643754-7d00-46b9-80cd-e097dd146eff tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:46.751162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-23643754-7d00-46b9-80cd-e097dd146eff tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.166630 Oct 27 14:16:46.751731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 884/1267] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:46 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:47.791759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e098f1a-7a67-49aa-8612-ecf546da5a62", "name": "network-vif-deleted", "tag": "60d5d634-d73e-43e2-9077-dd41c390011b"}, {"name": "network-changed", "server_uuid": "0cb7ac2c-4e45-46c4-8b56-062aac14258b", "tag": "e5f6c633-3fb1-4c33-8bba-2b47432ace5a"}, {"server_uuid": "70957fff-2020-4c1f-8829-004a5b2cb3f8", "name": "network-vif-deleted", "tag": "d3b6171c-067b-46e6-9907-3c63ab8ab975"}, {"server_uuid": "f40bbdf7-2daa-4c43-bb64-5d7e74d23348", "name": "network-vif-deleted", "tag": "aa6b322d-3edd-4f7e-8d3e-0fad55862f04"}, {"name": "network-changed", "server_uuid": "8d115154-f737-44a1-83d0-3ed7b44ab9f5", "tag": "d7dbd7ad-d681-4b28-a600-73b66f728573"}, {"server_uuid": "adbc567f-bc87-48cd-b910-ba46c84f914d", "name": "network-vif-deleted", "tag": "766d9692-5198-4c25-aa3a-d99900cc51b5"}, {"server_uuid": "41e12ebd-fe44-4aa9-8f5e-572d91370319", "name": "network-vif-deleted", "tag": "aab79689-5599-45f7-b77c-95b865b88b1d"}, {"server_uuid": "396ab30c-d8d7-48b2-a476-fe2cd2d21ce8", "name": "network-vif-deleted", "tag": "15887899-2093-4823-88fd-9157f73d58e7"}, {"name": "network-changed", "server_uuid": "e2e905cb-2edf-4221-933f-a7c59abcd554", "tag": "7cb0b496-4ac4-4e36-a183-d35a08ddccae"}, {"name": "network-changed", "server_uuid": "35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2", "tag": "dfabc39d-4ff3-4bef-a411-759d83df1689"}, {"server_uuid": "75d89b0d-7f54-43fe-ac03-194305453349", "name": "network-vif-deleted", "tag": "2a924378-fa68-4553-8201-a655778b931a"}, {"name": "network-changed", "server_uuid": "d42f6751-6bd2-4fd8-bce3-06d68f746b23", "tag": "5820d118-3b01-4edb-be39-b49d0e1eee59"}, {"name": "network-changed", "server_uuid": "35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2", "tag": "dfabc39d-4ff3-4bef-a411-759d83df1689"}, {"name": "network-changed", "server_uuid": "8d115154-f737-44a1-83d0-3ed7b44ab9f5", "tag": "d7dbd7ad-d681-4b28-a600-73b66f728573"}, {"name": "network-changed", "server_uuid": "8d115154-f737-44a1-83d0-3ed7b44ab9f5", "tag": "d7dbd7ad-d681-4b28-a600-73b66f728573"}, {"server_uuid": "8d115154-f737-44a1-83d0-3ed7b44ab9f5", "name": "network-vif-deleted", "tag": "d7dbd7ad-d681-4b28-a600-73b66f728573"}, {"name": "network-changed", "server_uuid": "d42f6751-6bd2-4fd8-bce3-06d68f746b23", "tag": "5820d118-3b01-4edb-be39-b49d0e1eee59"}, {"server_uuid": "35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2", "name": "network-vif-deleted", "tag": "dfabc39d-4ff3-4bef-a411-759d83df1689"}, {"name": "network-changed", "server_uuid": "c9f87a4f-0685-4f2c-b376-a5c84ddaf59c", "tag": "80d03754-d38d-4d13-a029-20c6ffb5685d"}, {"server_uuid": "e2e905cb-2edf-4221-933f-a7c59abcd554", "name": "network-vif-deleted", "tag": "7cb0b496-4ac4-4e36-a183-d35a08ddccae"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:16:47.795742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:16:47.795742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:16:47.810758 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:47.811332 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:47.839615 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-vif-deleted:60d5d634-d73e-43e2-9077-dd41c390011b for instance 1e098f1a-7a67-49aa-8612-ecf546da5a62 on hv-cinder-81566 Oct 27 14:16:47.840158 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-changed:e5f6c633-3fb1-4c33-8bba-2b47432ace5a for instance 0cb7ac2c-4e45-46c4-8b56-062aac14258b on hv-cinder-81566 Oct 27 14:16:47.840713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-vif-deleted:d3b6171c-067b-46e6-9907-3c63ab8ab975 for instance 70957fff-2020-4c1f-8829-004a5b2cb3f8 on hv-cinder-81566 Oct 27 14:16:47.841270 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-vif-deleted:aa6b322d-3edd-4f7e-8d3e-0fad55862f04 for instance f40bbdf7-2daa-4c43-bb64-5d7e74d23348 on hv-cinder-81566 Oct 27 14:16:47.841899 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-changed:d7dbd7ad-d681-4b28-a600-73b66f728573 for instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 on hv-cinder-81566 Oct 27 14:16:47.842466 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-vif-deleted:766d9692-5198-4c25-aa3a-d99900cc51b5 for instance adbc567f-bc87-48cd-b910-ba46c84f914d on hv-cinder-81566 Oct 27 14:16:47.843026 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-vif-deleted:aab79689-5599-45f7-b77c-95b865b88b1d for instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 on hv-cinder-81566 Oct 27 14:16:47.843659 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-vif-deleted:15887899-2093-4823-88fd-9157f73d58e7 for instance 396ab30c-d8d7-48b2-a476-fe2cd2d21ce8 on hv-cinder-81566 Oct 27 14:16:47.844218 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-changed:7cb0b496-4ac4-4e36-a183-d35a08ddccae for instance e2e905cb-2edf-4221-933f-a7c59abcd554 on hv-cinder-81566 Oct 27 14:16:47.845302 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-changed:dfabc39d-4ff3-4bef-a411-759d83df1689 for instance 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 on hv-cinder-81566 Oct 27 14:16:47.845302 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-vif-deleted:2a924378-fa68-4553-8201-a655778b931a for instance 75d89b0d-7f54-43fe-ac03-194305453349 on hv-cinder-81566 Oct 27 14:16:47.845724 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-changed:5820d118-3b01-4edb-be39-b49d0e1eee59 for instance d42f6751-6bd2-4fd8-bce3-06d68f746b23 on hv-cinder-81566 Oct 27 14:16:47.846201 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-changed:dfabc39d-4ff3-4bef-a411-759d83df1689 for instance 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 on hv-cinder-81566 Oct 27 14:16:47.846677 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-changed:d7dbd7ad-d681-4b28-a600-73b66f728573 for instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 on hv-cinder-81566 Oct 27 14:16:47.847169 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-changed:d7dbd7ad-d681-4b28-a600-73b66f728573 for instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 on hv-cinder-81566 Oct 27 14:16:47.847653 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-vif-deleted:d7dbd7ad-d681-4b28-a600-73b66f728573 for instance 8d115154-f737-44a1-83d0-3ed7b44ab9f5 on hv-cinder-81566 Oct 27 14:16:47.848123 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-changed:5820d118-3b01-4edb-be39-b49d0e1eee59 for instance d42f6751-6bd2-4fd8-bce3-06d68f746b23 on hv-cinder-81566 Oct 27 14:16:47.848777 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-vif-deleted:dfabc39d-4ff3-4bef-a411-759d83df1689 for instance 35f0ad1d-3b95-40a6-9fb4-35c1c4fcffc2 on hv-cinder-81566 Oct 27 14:16:47.849257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-changed:80d03754-d38d-4d13-a029-20c6ffb5685d for instance c9f87a4f-0685-4f2c-b376-a5c84ddaf59c on hv-cinder-81566 Oct 27 14:16:47.849740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] Creating event network-vif-deleted:7cb0b496-4ac4-4e36-a183-d35a08ddccae for instance e2e905cb-2edf-4221-933f-a7c59abcd554 on hv-cinder-81566 Oct 27 14:16:47.877076 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-5159fb44-f846-45a9-aeda-451e112ebc8b req-b974f2ab-d378-4d50-b065-49f259d8625c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 3392 microversion: 2.1 time: 0.228198 Oct 27 14:16:47.886644 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 885/1268] 10.222.0.85 () {64 vars in 1318 bytes} [Wed Oct 27 14:16:47 2021] POST /compute/v2.1/os-server-external-events => generated 3392 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:47.891879 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-b470d8e2-3ba9-41fb-9364-f2f0eb79937f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:47.892509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-b470d8e2-3ba9-41fb-9364-f2f0eb79937f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:47.899753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b470d8e2-3ba9-41fb-9364-f2f0eb79937f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:47.900612 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b470d8e2-3ba9-41fb-9364-f2f0eb79937f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:47.901662 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b470d8e2-3ba9-41fb-9364-f2f0eb79937f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:47.902257 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-b470d8e2-3ba9-41fb-9364-f2f0eb79937f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:48.154215 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-b470d8e2-3ba9-41fb-9364-f2f0eb79937f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:48.162906 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-b470d8e2-3ba9-41fb-9364-f2f0eb79937f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.274926 Oct 27 14:16:48.163957 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 886/1269] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:47 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:16:48.175987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c20e5def-d1c2-4876-b611-a3a67ad6926d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:48.177234 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c20e5def-d1c2-4876-b611-a3a67ad6926d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:48.184646 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c20e5def-d1c2-4876-b611-a3a67ad6926d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:48.185079 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c20e5def-d1c2-4876-b611-a3a67ad6926d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:48.185878 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c20e5def-d1c2-4876-b611-a3a67ad6926d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:48.186305 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c20e5def-d1c2-4876-b611-a3a67ad6926d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:48.203688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-c20e5def-d1c2-4876-b611-a3a67ad6926d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] HTTP exception thrown: Instance e2e905cb-2edf-4221-933f-a7c59abcd554 could not be found. Oct 27 14:16:48.204300 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c20e5def-d1c2-4876-b611-a3a67ad6926d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Returning 404 to user: Instance e2e905cb-2edf-4221-933f-a7c59abcd554 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:16:48.205279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c20e5def-d1c2-4876-b611-a3a67ad6926d tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 404 len: 111 microversion: 2.1 time: 0.040315 Oct 27 14:16:48.209274 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 887/1270] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:16:48 2021] DELETE /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:16:48.214908 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-c61a365d-f71d-458f-8bb5-b19938d7c677 req-d5c28cc3-aa64-4984-b236-cdee10d4a1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f87a4f-0685-4f2c-b376-a5c84ddaf59c", "name": "network-vif-plugged", "status": "completed", "tag": "80d03754-d38d-4d13-a029-20c6ffb5685d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:16:48.216649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:16:48.216649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:16:48.223987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-c61a365d-f71d-458f-8bb5-b19938d7c677 req-d5c28cc3-aa64-4984-b236-cdee10d4a1e9 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:48.224731 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-c61a365d-f71d-458f-8bb5-b19938d7c677 req-d5c28cc3-aa64-4984-b236-cdee10d4a1e9 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:48.238516 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-c61a365d-f71d-458f-8bb5-b19938d7c677 req-d5c28cc3-aa64-4984-b236-cdee10d4a1e9 service nova] Creating event network-vif-plugged:80d03754-d38d-4d13-a029-20c6ffb5685d for instance c9f87a4f-0685-4f2c-b376-a5c84ddaf59c on hv-cinder-81566 Oct 27 14:16:48.245202 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-c61a365d-f71d-458f-8bb5-b19938d7c677 req-d5c28cc3-aa64-4984-b236-cdee10d4a1e9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034119 Oct 27 14:16:48.246399 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 888/1271] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:16:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:16:48.253993 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7cf5a70c-10f8-4427-9573-7c5a9a2a2665 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:48.254251 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:16:48.254251 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Wed Oct 27 14:16:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Oct 27 14:16:48.255568 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7cf5a70c-10f8-4427-9573-7c5a9a2a2665 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: e2e905cb-2edf-4221-933f-a7c59abcd554] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:48.266057 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7cf5a70c-10f8-4427-9573-7c5a9a2a2665 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:48.267064 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7cf5a70c-10f8-4427-9573-7c5a9a2a2665 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:48.268072 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7cf5a70c-10f8-4427-9573-7c5a9a2a2665 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:48.268916 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7cf5a70c-10f8-4427-9573-7c5a9a2a2665 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:48.288008 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-7cf5a70c-10f8-4427-9573-7c5a9a2a2665 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] HTTP exception thrown: Instance e2e905cb-2edf-4221-933f-a7c59abcd554 could not be found. Oct 27 14:16:48.288613 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7cf5a70c-10f8-4427-9573-7c5a9a2a2665 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Returning 404 to user: Instance e2e905cb-2edf-4221-933f-a7c59abcd554 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:16:48.290241 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7cf5a70c-10f8-4427-9573-7c5a9a2a2665 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554" status: 404 len: 111 microversion: 2.1 time: 0.041301 Oct 27 14:16:48.291059 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 889/1272] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:48 2021] GET /compute/v2.1/servers/e2e905cb-2edf-4221-933f-a7c59abcd554 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:16:49.189001 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-a4242af9-d74c-4582-bcf0-15879dd0f810 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:49.189647 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-a4242af9-d74c-4582-bcf0-15879dd0f810 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:49.196450 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4242af9-d74c-4582-bcf0-15879dd0f810 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:49.196889 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4242af9-d74c-4582-bcf0-15879dd0f810 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:49.197654 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4242af9-d74c-4582-bcf0-15879dd0f810 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:49.198080 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-a4242af9-d74c-4582-bcf0-15879dd0f810 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:49.417161 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-a4242af9-d74c-4582-bcf0-15879dd0f810 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:49.426859 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-a4242af9-d74c-4582-bcf0-15879dd0f810 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1265 microversion: 2.1 time: 0.241549 Oct 27 14:16:49.427469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 890/1273] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:49 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:16:49.466434 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7099f324-57cb-44a4-95ec-3d92137305b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:49.466966 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7099f324-57cb-44a4-95ec-3d92137305b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:49.473543 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7099f324-57cb-44a4-95ec-3d92137305b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:49.474043 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7099f324-57cb-44a4-95ec-3d92137305b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:49.474829 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7099f324-57cb-44a4-95ec-3d92137305b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:49.475406 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7099f324-57cb-44a4-95ec-3d92137305b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:49.489162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-7099f324-57cb-44a4-95ec-3d92137305b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] HTTP exception thrown: Instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 could not be found. Oct 27 14:16:49.489765 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7099f324-57cb-44a4-95ec-3d92137305b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Returning 404 to user: Instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:16:49.490591 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7099f324-57cb-44a4-95ec-3d92137305b1 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "DELETE /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 404 len: 111 microversion: 2.1 time: 0.028325 Oct 27 14:16:49.491355 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 891/1274] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:16:49 2021] DELETE /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:16:49.499541 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-84f5acfe-d39c-4dc4-8c9b-24a7858eaf38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:49.500147 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-84f5acfe-d39c-4dc4-8c9b-24a7858eaf38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] [instance: 41e12ebd-fe44-4aa9-8f5e-572d91370319] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:49.506294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-84f5acfe-d39c-4dc4-8c9b-24a7858eaf38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:49.506662 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-84f5acfe-d39c-4dc4-8c9b-24a7858eaf38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:49.507481 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-84f5acfe-d39c-4dc4-8c9b-24a7858eaf38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:49.507900 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-84f5acfe-d39c-4dc4-8c9b-24a7858eaf38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:49.522779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-84f5acfe-d39c-4dc4-8c9b-24a7858eaf38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] HTTP exception thrown: Instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 could not be found. Oct 27 14:16:49.523412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-84f5acfe-d39c-4dc4-8c9b-24a7858eaf38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] Returning 404 to user: Instance 41e12ebd-fe44-4aa9-8f5e-572d91370319 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:16:49.524566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-84f5acfe-d39c-4dc4-8c9b-24a7858eaf38 tempest-AttachVolumeShelveTestJSON-1000405035 tempest-AttachVolumeShelveTestJSON-1000405035-project] 10.222.0.85 "GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319" status: 404 len: 111 microversion: 2.1 time: 0.028504 Oct 27 14:16:49.525192 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 892/1275] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:49 2021] GET /compute/v2.1/servers/41e12ebd-fe44-4aa9-8f5e-572d91370319 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:16:50.444307 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-591fc1c9-358c-4029-b3f6-b63aebd0ca4c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:50.445281 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-591fc1c9-358c-4029-b3f6-b63aebd0ca4c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:50.452741 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-591fc1c9-358c-4029-b3f6-b63aebd0ca4c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:50.453188 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-591fc1c9-358c-4029-b3f6-b63aebd0ca4c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:50.453961 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-591fc1c9-358c-4029-b3f6-b63aebd0ca4c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:50.454441 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-591fc1c9-358c-4029-b3f6-b63aebd0ca4c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:50.689726 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-591fc1c9-358c-4029-b3f6-b63aebd0ca4c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:50.712285 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-591fc1c9-358c-4029-b3f6-b63aebd0ca4c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1452 microversion: 2.1 time: 0.270830 Oct 27 14:16:50.713992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 893/1276] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:50 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1452 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:16:50.737740 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-87f6a256-4c26-4f75-a601-0c0b33a88b8d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:16:50.738779 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-87f6a256-4c26-4f75-a601-0c0b33a88b8d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:16:50.745468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87f6a256-4c26-4f75-a601-0c0b33a88b8d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:50.746412 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87f6a256-4c26-4f75-a601-0c0b33a88b8d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:50.747483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87f6a256-4c26-4f75-a601-0c0b33a88b8d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:50.748140 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-87f6a256-4c26-4f75-a601-0c0b33a88b8d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:50.942939 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-87f6a256-4c26-4f75-a601-0c0b33a88b8d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:16:50.953753 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-87f6a256-4c26-4f75-a601-0c0b33a88b8d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1452 microversion: 2.1 time: 0.226861 Oct 27 14:16:50.954418 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 894/1277] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:16:50 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:16:54.134628 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-1431069f-cdb5-4851-ae99-b5003412afa6 req-78bc6769-fd7d-4413-bbef-3d32ebcb7bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f87a4f-0685-4f2c-b376-a5c84ddaf59c", "tag": "80d03754-d38d-4d13-a029-20c6ffb5685d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:16:54.137331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:16:54.137331 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:16:54.144744 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-1431069f-cdb5-4851-ae99-b5003412afa6 req-78bc6769-fd7d-4413-bbef-3d32ebcb7bc4 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:16:54.145420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-1431069f-cdb5-4851-ae99-b5003412afa6 req-78bc6769-fd7d-4413-bbef-3d32ebcb7bc4 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:16:54.157688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-1431069f-cdb5-4851-ae99-b5003412afa6 req-78bc6769-fd7d-4413-bbef-3d32ebcb7bc4 service nova] Creating event network-changed:80d03754-d38d-4d13-a029-20c6ffb5685d for instance c9f87a4f-0685-4f2c-b376-a5c84ddaf59c on hv-cinder-81566 Oct 27 14:16:54.162674 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-1431069f-cdb5-4851-ae99-b5003412afa6 req-78bc6769-fd7d-4413-bbef-3d32ebcb7bc4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032520 Oct 27 14:16:54.163511 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 895/1278] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:17:39.229375 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-330896d0-feba-43aa-acfc-b906b3c3f588 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:17:39.230132 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-330896d0-feba-43aa-acfc-b906b3c3f588 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:17:39.237469 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-330896d0-feba-43aa-acfc-b906b3c3f588 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:39.237911 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-330896d0-feba-43aa-acfc-b906b3c3f588 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:39.238674 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-330896d0-feba-43aa-acfc-b906b3c3f588 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:39.239144 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-330896d0-feba-43aa-acfc-b906b3c3f588 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:39.266306 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-330896d0-feba-43aa-acfc-b906b3c3f588 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:17:39.355932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-330896d0-feba-43aa-acfc-b906b3c3f588 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "DELETE /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 204 len: 0 microversion: 2.1 time: 0.130572 Oct 27 14:17:39.356794 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 896/1279] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:17:39 2021] DELETE /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:17:39.363193 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-09009996-0189-4483-a918-4a0ce2069e35 req-8362ea12-ac07-4f66-b8cc-610fa3efb914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb7ac2c-4e45-46c4-8b56-062aac14258b", "tag": "e5f6c633-3fb1-4c33-8bba-2b47432ace5a"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:17:39.365052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:17:39.365052 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:17:39.372061 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-09009996-0189-4483-a918-4a0ce2069e35 req-8362ea12-ac07-4f66-b8cc-610fa3efb914 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:39.372517 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-09009996-0189-4483-a918-4a0ce2069e35 req-8362ea12-ac07-4f66-b8cc-610fa3efb914 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:39.384695 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-09009996-0189-4483-a918-4a0ce2069e35 req-8362ea12-ac07-4f66-b8cc-610fa3efb914 service nova] Creating event network-changed:e5f6c633-3fb1-4c33-8bba-2b47432ace5a for instance 0cb7ac2c-4e45-46c4-8b56-062aac14258b on hv-cinder-81566 Oct 27 14:17:39.390877 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-09009996-0189-4483-a918-4a0ce2069e35 req-8362ea12-ac07-4f66-b8cc-610fa3efb914 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Oct 27 14:17:39.391759 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 897/1280] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:17:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:17:39.397711 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-5c634b3a-0a12-4241-840a-2e8fa472fb51 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:17:39.398653 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-5c634b3a-0a12-4241-840a-2e8fa472fb51 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:17:39.405715 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c634b3a-0a12-4241-840a-2e8fa472fb51 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:39.406590 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c634b3a-0a12-4241-840a-2e8fa472fb51 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:39.407584 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c634b3a-0a12-4241-840a-2e8fa472fb51 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:39.408020 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-5c634b3a-0a12-4241-840a-2e8fa472fb51 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:39.664673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-5c634b3a-0a12-4241-840a-2e8fa472fb51 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:17:39.673748 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-5c634b3a-0a12-4241-840a-2e8fa472fb51 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1569 microversion: 2.1 time: 0.280664 Oct 27 14:17:39.674330 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 898/1281] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:17:39 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1569 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:17:40.692303 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-7febe399-ec70-4f9d-8759-804ed1e0b7c3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:17:40.692997 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-7febe399-ec70-4f9d-8759-804ed1e0b7c3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:17:40.699457 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7febe399-ec70-4f9d-8759-804ed1e0b7c3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:40.699902 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7febe399-ec70-4f9d-8759-804ed1e0b7c3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:40.700736 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7febe399-ec70-4f9d-8759-804ed1e0b7c3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:40.701217 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-7febe399-ec70-4f9d-8759-804ed1e0b7c3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:40.862619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-7febe399-ec70-4f9d-8759-804ed1e0b7c3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:17:40.869869 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-7febe399-ec70-4f9d-8759-804ed1e0b7c3 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1450 microversion: 2.1 time: 0.181307 Oct 27 14:17:40.870433 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 899/1282] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:17:40 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1450 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:17:41.887279 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-241d73d7-d8e6-433b-986f-23a0185e9030 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:17:41.888157 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-241d73d7-d8e6-433b-986f-23a0185e9030 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:17:41.898938 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-241d73d7-d8e6-433b-986f-23a0185e9030 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:41.899526 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-241d73d7-d8e6-433b-986f-23a0185e9030 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:41.900199 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-241d73d7-d8e6-433b-986f-23a0185e9030 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:41.900635 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-241d73d7-d8e6-433b-986f-23a0185e9030 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:41.974500 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-241d73d7-d8e6-433b-986f-23a0185e9030 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e52a4ba12e74a0b828bb63d198516c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c924da1e65494809b6ceaf4b8a10e166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:17:41.984795 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-241d73d7-d8e6-433b-986f-23a0185e9030 tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 200 len: 1382 microversion: 2.1 time: 0.101114 Oct 27 14:17:41.985491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 900/1283] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:17:41 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 1382 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:17:41.989673 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-b3b2b28a-1d0a-474d-926d-ac039c5d4d35 req-bf5ad8db-843b-4399-acc0-980d518e4259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb7ac2c-4e45-46c4-8b56-062aac14258b", "name": "network-vif-deleted", "tag": "e5f6c633-3fb1-4c33-8bba-2b47432ace5a"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:17:41.991216 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:17:41.991216 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:17:42.002942 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-b3b2b28a-1d0a-474d-926d-ac039c5d4d35 req-bf5ad8db-843b-4399-acc0-980d518e4259 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:42.003483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-b3b2b28a-1d0a-474d-926d-ac039c5d4d35 req-bf5ad8db-843b-4399-acc0-980d518e4259 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:42.015362 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-b3b2b28a-1d0a-474d-926d-ac039c5d4d35 req-bf5ad8db-843b-4399-acc0-980d518e4259 service nova] Creating event network-vif-deleted:e5f6c633-3fb1-4c33-8bba-2b47432ace5a for instance 0cb7ac2c-4e45-46c4-8b56-062aac14258b on hv-cinder-81566 Oct 27 14:17:42.021552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-b3b2b28a-1d0a-474d-926d-ac039c5d4d35 req-bf5ad8db-843b-4399-acc0-980d518e4259 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034787 Oct 27 14:17:42.022171 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 901/1284] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:17:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:17:43.002703 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ed4c7f63-296e-41d9-849a-7c2cfc5113aa tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:17:43.003434 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ed4c7f63-296e-41d9-849a-7c2cfc5113aa tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] [instance: 0cb7ac2c-4e45-46c4-8b56-062aac14258b] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:17:43.009844 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ed4c7f63-296e-41d9-849a-7c2cfc5113aa tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:43.010295 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ed4c7f63-296e-41d9-849a-7c2cfc5113aa tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:43.011069 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ed4c7f63-296e-41d9-849a-7c2cfc5113aa tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:17:43.011530 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ed4c7f63-296e-41d9-849a-7c2cfc5113aa tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:17:43.024612 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-ed4c7f63-296e-41d9-849a-7c2cfc5113aa tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] HTTP exception thrown: Instance 0cb7ac2c-4e45-46c4-8b56-062aac14258b could not be found. Oct 27 14:17:43.025203 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ed4c7f63-296e-41d9-849a-7c2cfc5113aa tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Returning 404 to user: Instance 0cb7ac2c-4e45-46c4-8b56-062aac14258b could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:17:43.026088 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ed4c7f63-296e-41d9-849a-7c2cfc5113aa tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b" status: 404 len: 111 microversion: 2.1 time: 0.028112 Oct 27 14:17:43.026812 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 902/1285] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:17:42 2021] GET /compute/v2.1/servers/0cb7ac2c-4e45-46c4-8b56-062aac14258b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 14:17:43.192987 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-eccda35f-a79a-461d-8119-92217b556c2e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] Calling method '.version_select at 0x7f4574da75e0>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:17:43.213579 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-eccda35f-a79a-461d-8119-92217b556c2e tempest-TestShelveInstance-461600073 tempest-TestShelveInstance-461600073-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-707784463" status: 202 len: 0 microversion: 2.1 time: 0.023979 Oct 27 14:17:43.214379 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 903/1286] 10.222.0.85 () {58 vars in 1250 bytes} [Wed Oct 27 14:17:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-707784463 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:18:26.044175 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:18:26.044740 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Wed Oct 27 14:18:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Oct 27 14:18:30.895943 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9bc5090e-1a34-4be1-93cd-1d8ddd9ac98d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:30.896505 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9bc5090e-1a34-4be1-93cd-1d8ddd9ac98d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:30.903166 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9bc5090e-1a34-4be1-93cd-1d8ddd9ac98d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:30.903688 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9bc5090e-1a34-4be1-93cd-1d8ddd9ac98d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:30.904524 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9bc5090e-1a34-4be1-93cd-1d8ddd9ac98d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:30.905027 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9bc5090e-1a34-4be1-93cd-1d8ddd9ac98d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:30.929662 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9bc5090e-1a34-4be1-93cd-1d8ddd9ac98d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:18:31.007190 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9bc5090e-1a34-4be1-93cd-1d8ddd9ac98d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 204 len: 0 microversion: 2.1 time: 0.115781 Oct 27 14:18:31.011339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 904/1287] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:18:30 2021] DELETE /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:18:31.014709 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-48e8793e-ef8b-49bf-9f95-8536ba83e9cb req-06053efd-4ef4-4b16-9fce-572264397d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f87a4f-0685-4f2c-b376-a5c84ddaf59c", "tag": "80d03754-d38d-4d13-a029-20c6ffb5685d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:18:31.016339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:18:31.016339 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:18:31.024129 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-48e8793e-ef8b-49bf-9f95-8536ba83e9cb req-06053efd-4ef4-4b16-9fce-572264397d07 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:31.024566 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-48e8793e-ef8b-49bf-9f95-8536ba83e9cb req-06053efd-4ef4-4b16-9fce-572264397d07 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:31.035953 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-48e8793e-ef8b-49bf-9f95-8536ba83e9cb req-06053efd-4ef4-4b16-9fce-572264397d07 service nova] Creating event network-changed:80d03754-d38d-4d13-a029-20c6ffb5685d for instance c9f87a4f-0685-4f2c-b376-a5c84ddaf59c on hv-cinder-81566 Oct 27 14:18:31.040713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-48e8793e-ef8b-49bf-9f95-8536ba83e9cb req-06053efd-4ef4-4b16-9fce-572264397d07 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031697 Oct 27 14:18:31.041303 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 905/1288] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:18:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:18:31.046062 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c79b572b-9a07-450e-806d-cfae924ebbfb tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:31.046752 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c79b572b-9a07-450e-806d-cfae924ebbfb tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:31.052742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c79b572b-9a07-450e-806d-cfae924ebbfb tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:31.053189 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c79b572b-9a07-450e-806d-cfae924ebbfb tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:31.053958 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c79b572b-9a07-450e-806d-cfae924ebbfb tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:31.054395 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c79b572b-9a07-450e-806d-cfae924ebbfb tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:31.428559 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-c79b572b-9a07-450e-806d-cfae924ebbfb tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:18:31.436214 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c79b572b-9a07-450e-806d-cfae924ebbfb tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1576 microversion: 2.1 time: 0.393790 Oct 27 14:18:31.447491 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 906/1289] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:18:31 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1576 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:18:32.454152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9dc7ee62-268c-4a41-8dcf-278d9f3f3bd7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:32.454844 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9dc7ee62-268c-4a41-8dcf-278d9f3f3bd7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:32.461276 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dc7ee62-268c-4a41-8dcf-278d9f3f3bd7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:32.461718 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dc7ee62-268c-4a41-8dcf-278d9f3f3bd7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:32.462472 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dc7ee62-268c-4a41-8dcf-278d9f3f3bd7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:32.462907 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9dc7ee62-268c-4a41-8dcf-278d9f3f3bd7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:32.584063 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-9dc7ee62-268c-4a41-8dcf-278d9f3f3bd7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:18:32.591314 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9dc7ee62-268c-4a41-8dcf-278d9f3f3bd7 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1458 microversion: 2.1 time: 0.140840 Oct 27 14:18:32.591873 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 907/1290] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:18:32 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1458 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:18:33.586262 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-f7d3d399-8194-4ce8-9b3a-958e87c646ec req-30e4a244-f4d0-4d26-aa86-8c3a18bb8fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f87a4f-0685-4f2c-b376-a5c84ddaf59c", "name": "network-vif-deleted", "tag": "80d03754-d38d-4d13-a029-20c6ffb5685d"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:18:33.587992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:18:33.587992 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:18:33.595550 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-f7d3d399-8194-4ce8-9b3a-958e87c646ec req-30e4a244-f4d0-4d26-aa86-8c3a18bb8fa3 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:33.595983 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-f7d3d399-8194-4ce8-9b3a-958e87c646ec req-30e4a244-f4d0-4d26-aa86-8c3a18bb8fa3 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:33.607417 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-f7d3d399-8194-4ce8-9b3a-958e87c646ec req-30e4a244-f4d0-4d26-aa86-8c3a18bb8fa3 service nova] Creating event network-vif-deleted:80d03754-d38d-4d13-a029-20c6ffb5685d for instance c9f87a4f-0685-4f2c-b376-a5c84ddaf59c on hv-cinder-81566 Oct 27 14:18:33.612769 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-f7d3d399-8194-4ce8-9b3a-958e87c646ec req-30e4a244-f4d0-4d26-aa86-8c3a18bb8fa3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030275 Oct 27 14:18:33.614176 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 908/1291] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:18:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:18:33.618896 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-60b19c3c-0d6f-42e6-a6c6-59e1bc131d2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:33.619619 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-60b19c3c-0d6f-42e6-a6c6-59e1bc131d2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:33.626612 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-60b19c3c-0d6f-42e6-a6c6-59e1bc131d2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:33.627066 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-60b19c3c-0d6f-42e6-a6c6-59e1bc131d2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:33.627903 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-60b19c3c-0d6f-42e6-a6c6-59e1bc131d2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:33.628341 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-60b19c3c-0d6f-42e6-a6c6-59e1bc131d2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:33.694415 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-60b19c3c-0d6f-42e6-a6c6-59e1bc131d2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:18:33.701771 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-60b19c3c-0d6f-42e6-a6c6-59e1bc131d2c tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 200 len: 1225 microversion: 2.1 time: 0.086448 Oct 27 14:18:33.702324 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 909/1292] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:18:33 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:18:34.718932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8405037f-7a53-4973-9e89-cc99f963c062 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:34.719597 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8405037f-7a53-4973-9e89-cc99f963c062 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: c9f87a4f-0685-4f2c-b376-a5c84ddaf59c] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:34.726401 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8405037f-7a53-4973-9e89-cc99f963c062 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:34.726846 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8405037f-7a53-4973-9e89-cc99f963c062 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:34.727655 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8405037f-7a53-4973-9e89-cc99f963c062 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:34.728071 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8405037f-7a53-4973-9e89-cc99f963c062 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:34.741403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-8405037f-7a53-4973-9e89-cc99f963c062 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] HTTP exception thrown: Instance c9f87a4f-0685-4f2c-b376-a5c84ddaf59c could not be found. Oct 27 14:18:34.741978 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8405037f-7a53-4973-9e89-cc99f963c062 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Returning 404 to user: Instance c9f87a4f-0685-4f2c-b376-a5c84ddaf59c could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:18:34.742778 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8405037f-7a53-4973-9e89-cc99f963c062 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c" status: 404 len: 111 microversion: 2.1 time: 0.027550 Oct 27 14:18:34.743320 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 910/1293] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:18:34 2021] GET /compute/v2.1/servers/c9f87a4f-0685-4f2c-b376-a5c84ddaf59c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:18:37.772684 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-8f42b38f-cf81-4eda-a768-85651cfa9e7f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:37.773294 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8f42b38f-cf81-4eda-a768-85651cfa9e7f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:37.779617 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f42b38f-cf81-4eda-a768-85651cfa9e7f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:37.780062 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f42b38f-cf81-4eda-a768-85651cfa9e7f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:37.780832 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f42b38f-cf81-4eda-a768-85651cfa9e7f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:37.781265 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-8f42b38f-cf81-4eda-a768-85651cfa9e7f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:37.806420 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-8f42b38f-cf81-4eda-a768-85651cfa9e7f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Going to try to terminate instance {{(pid=115931) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 27 14:18:37.881648 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-8f42b38f-cf81-4eda-a768-85651cfa9e7f tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 204 len: 0 microversion: 2.1 time: 0.113094 Oct 27 14:18:37.882155 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 911/1294] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:18:37 2021] DELETE /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 14:18:37.887229 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-ec87a9cb-a901-4a57-b0ba-dab1f4217dbf req-5c4a77d5-8291-462b-bf5b-4debf5ed9b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42f6751-6bd2-4fd8-bce3-06d68f746b23", "tag": "5820d118-3b01-4edb-be39-b49d0e1eee59"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:18:37.888710 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:18:37.888710 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:18:37.896162 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-ec87a9cb-a901-4a57-b0ba-dab1f4217dbf req-5c4a77d5-8291-462b-bf5b-4debf5ed9b69 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:37.896602 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-ec87a9cb-a901-4a57-b0ba-dab1f4217dbf req-5c4a77d5-8291-462b-bf5b-4debf5ed9b69 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:37.908030 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-ec87a9cb-a901-4a57-b0ba-dab1f4217dbf req-5c4a77d5-8291-462b-bf5b-4debf5ed9b69 service nova] Creating event network-changed:5820d118-3b01-4edb-be39-b49d0e1eee59 for instance d42f6751-6bd2-4fd8-bce3-06d68f746b23 on hv-cinder-81566 Oct 27 14:18:37.912932 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-ec87a9cb-a901-4a57-b0ba-dab1f4217dbf req-5c4a77d5-8291-462b-bf5b-4debf5ed9b69 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029493 Oct 27 14:18:37.913512 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 912/1295] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:18:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 14:18:37.918509 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-d56974f9-9140-4e68-ae69-2dfad743d00d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:37.918906 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-d56974f9-9140-4e68-ae69-2dfad743d00d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:37.924823 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d56974f9-9140-4e68-ae69-2dfad743d00d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:37.925266 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d56974f9-9140-4e68-ae69-2dfad743d00d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:37.926133 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d56974f9-9140-4e68-ae69-2dfad743d00d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:37.926614 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-d56974f9-9140-4e68-ae69-2dfad743d00d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:38.092097 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-d56974f9-9140-4e68-ae69-2dfad743d00d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:18:38.100365 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-d56974f9-9140-4e68-ae69-2dfad743d00d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1576 microversion: 2.1 time: 0.185719 Oct 27 14:18:38.101152 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 913/1296] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:18:37 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 14:18:39.117596 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-3e2b048a-5913-4640-9b50-f4df7b24340d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:39.118277 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-3e2b048a-5913-4640-9b50-f4df7b24340d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:39.124403 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3e2b048a-5913-4640-9b50-f4df7b24340d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:39.124866 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3e2b048a-5913-4640-9b50-f4df7b24340d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:39.125629 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3e2b048a-5913-4640-9b50-f4df7b24340d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:39.126054 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-3e2b048a-5913-4640-9b50-f4df7b24340d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:39.247626 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-3e2b048a-5913-4640-9b50-f4df7b24340d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:18:39.255959 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-3e2b048a-5913-4640-9b50-f4df7b24340d tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1457 microversion: 2.1 time: 0.142022 Oct 27 14:18:39.256527 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 914/1297] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:18:39 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1457 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:18:40.224049 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [req-0058edea-97f8-48fe-87b1-e5ba6ed115c6 req-0ae9a0b7-b29e-48be-a16e-3bde59652382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42f6751-6bd2-4fd8-bce3-06d68f746b23", "name": "network-vif-deleted", "tag": "5820d118-3b01-4edb-be39-b49d0e1eee59"}]} {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 14:18:40.225649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:18:40.225649 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: warnings.warn(msg) Oct 27 14:18:40.234118 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-0058edea-97f8-48fe-87b1-e5ba6ed115c6 req-0ae9a0b7-b29e-48be-a16e-3bde59652382 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:40.234552 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [req-0058edea-97f8-48fe-87b1-e5ba6ed115c6 req-0ae9a0b7-b29e-48be-a16e-3bde59652382 service nova] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:40.246520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.compute.server_external_events [req-0058edea-97f8-48fe-87b1-e5ba6ed115c6 req-0ae9a0b7-b29e-48be-a16e-3bde59652382 service nova] Creating event network-vif-deleted:5820d118-3b01-4edb-be39-b49d0e1eee59 for instance d42f6751-6bd2-4fd8-bce3-06d68f746b23 on hv-cinder-81566 Oct 27 14:18:40.251504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [req-0058edea-97f8-48fe-87b1-e5ba6ed115c6 req-0ae9a0b7-b29e-48be-a16e-3bde59652382 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031779 Oct 27 14:18:40.252093 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 915/1298] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Oct 27 14:18:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 14:18:40.273340 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-34621807-b6e9-4c40-b88f-6c366b356a16 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:40.274143 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-34621807-b6e9-4c40-b88f-6c366b356a16 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:40.280563 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34621807-b6e9-4c40-b88f-6c366b356a16 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:40.281010 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34621807-b6e9-4c40-b88f-6c366b356a16 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:40.281773 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34621807-b6e9-4c40-b88f-6c366b356a16 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:40.282200 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-34621807-b6e9-4c40-b88f-6c366b356a16 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:40.343388 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.policy [None req-34621807-b6e9-4c40-b88f-6c366b356a16 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa9c479260384120a439e7f8c2dd122f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925d32172c5f44168c2eddeffc0a7da1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115931) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 14:18:40.351980 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-34621807-b6e9-4c40-b88f-6c366b356a16 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 200 len: 1225 microversion: 2.1 time: 0.083413 Oct 27 14:18:40.352553 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 916/1299] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:18:40 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 14:18:41.369023 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c88712a3-5b8f-4dc1-9567-ecccd622c922 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:41.369693 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-c88712a3-5b8f-4dc1-9567-ecccd622c922 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: d42f6751-6bd2-4fd8-bce3-06d68f746b23] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:41.376298 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c88712a3-5b8f-4dc1-9567-ecccd622c922 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:41.376742 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c88712a3-5b8f-4dc1-9567-ecccd622c922 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:41.377504 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c88712a3-5b8f-4dc1-9567-ecccd622c922 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:41.377936 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-c88712a3-5b8f-4dc1-9567-ecccd622c922 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:41.394580 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-c88712a3-5b8f-4dc1-9567-ecccd622c922 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] HTTP exception thrown: Instance d42f6751-6bd2-4fd8-bce3-06d68f746b23 could not be found. Oct 27 14:18:41.395280 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-c88712a3-5b8f-4dc1-9567-ecccd622c922 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Returning 404 to user: Instance d42f6751-6bd2-4fd8-bce3-06d68f746b23 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:18:41.396915 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-c88712a3-5b8f-4dc1-9567-ecccd622c922 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23" status: 404 len: 111 microversion: 2.1 time: 0.031652 Oct 27 14:18:41.397456 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 917/1300] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:18:41 2021] GET /compute/v2.1/servers/d42f6751-6bd2-4fd8-bce3-06d68f746b23 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:18:41.852884 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9b9509b3-53a6-4bd9-9249-c781aafe5264 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:41.853385 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-9b9509b3-53a6-4bd9-9249-c781aafe5264 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:41.859263 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b9509b3-53a6-4bd9-9249-c781aafe5264 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:41.859713 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b9509b3-53a6-4bd9-9249-c781aafe5264 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:41.860476 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b9509b3-53a6-4bd9-9249-c781aafe5264 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:41.860913 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-9b9509b3-53a6-4bd9-9249-c781aafe5264 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:41.874098 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-9b9509b3-53a6-4bd9-9249-c781aafe5264 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] HTTP exception thrown: Instance 75d89b0d-7f54-43fe-ac03-194305453349 could not be found. Oct 27 14:18:41.874679 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-9b9509b3-53a6-4bd9-9249-c781aafe5264 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Returning 404 to user: Instance 75d89b0d-7f54-43fe-ac03-194305453349 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:18:41.875520 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-9b9509b3-53a6-4bd9-9249-c781aafe5264 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "DELETE /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 404 len: 111 microversion: 2.1 time: 0.026362 Oct 27 14:18:41.876167 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 918/1301] 10.222.0.85 () {58 vars in 1238 bytes} [Wed Oct 27 14:18:41 2021] DELETE /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:18:41.883429 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ec5426ca-d0e4-4bb2-b5f1-29f98e444382 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:41.884018 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.compute.api [None req-ec5426ca-d0e4-4bb2-b5f1-29f98e444382 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] [instance: 75d89b0d-7f54-43fe-ac03-194305453349] Fetching instance by UUID {{(pid=115931) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 27 14:18:41.889483 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ec5426ca-d0e4-4bb2-b5f1-29f98e444382 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:41.889919 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ec5426ca-d0e4-4bb2-b5f1-29f98e444382 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:41.890665 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ec5426ca-d0e4-4bb2-b5f1-29f98e444382 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 27 14:18:41.891089 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG oslo_concurrency.lockutils [None req-ec5426ca-d0e4-4bb2-b5f1-29f98e444382 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Lock "c89c5998-b04c-4a8a-a40e-c04db17dd463" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 27 14:18:41.904261 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.wsgi [None req-ec5426ca-d0e4-4bb2-b5f1-29f98e444382 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] HTTP exception thrown: Instance 75d89b0d-7f54-43fe-ac03-194305453349 could not be found. Oct 27 14:18:41.904762 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-ec5426ca-d0e4-4bb2-b5f1-29f98e444382 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Returning 404 to user: Instance 75d89b0d-7f54-43fe-ac03-194305453349 could not be found. {{(pid=115931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 27 14:18:41.905546 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-ec5426ca-d0e4-4bb2-b5f1-29f98e444382 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349" status: 404 len: 111 microversion: 2.1 time: 0.025447 Oct 27 14:18:41.906041 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 919/1302] 10.222.0.85 () {58 vars in 1235 bytes} [Wed Oct 27 14:18:41 2021] GET /compute/v2.1/servers/75d89b0d-7f54-43fe-ac03-194305453349 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 14:18:43.180156 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: DEBUG nova.api.openstack.wsgi [None req-584b5805-59d6-4cdb-9417-ef79bc323bd1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] Calling method '.version_select at 0x7f4570ac8d30>' {{(pid=115931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 14:18:43.199159 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO nova.api.openstack.requestlog [None req-584b5805-59d6-4cdb-9417-ef79bc323bd1 tempest-TestVolumeBootPattern-1718456104 tempest-TestVolumeBootPattern-1718456104-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1521029144" status: 202 len: 0 microversion: 2.1 time: 0.022567 Oct 27 14:18:43.199744 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: [pid: 115931|app: 0|req: 920/1303] 10.222.0.85 () {58 vars in 1262 bytes} [Wed Oct 27 14:18:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1521029144 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 14:19:49.966223 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:19:49.966902 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Wed Oct 27 14:19:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Oct 27 14:20:08.275173 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:20:08.275869 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Wed Oct 27 14:20:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Oct 27 14:21:33.427125 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:21:33.427751 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: Wed Oct 27 14:21:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 14:21:46.062389 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:21:46.062978 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Wed Oct 27 14:21:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Oct 27 14:21:52.758468 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:21:52.759000 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: Wed Oct 27 14:21:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 27 14:23:09.983805 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:23:09.984408 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Wed Oct 27 14:23:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Oct 27 14:23:28.293363 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:23:28.294062 dv-cinder-815660-2-iscsi devstack@n-api.service[115932]: Wed Oct 27 14:23:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.85) !!! Oct 27 14:23:55.752876 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 14:23:55.753485 dv-cinder-815660-2-iscsi devstack@n-api.service[115931]: Wed Oct 27 14:23:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!